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THE  VERSATILE  MAINTENANCE  EXPERT  SYSTEM  (VMES) 
RESEARCH  PROJECT 


2A.1  TECHNICAL  OVERVIEW 
2A.1.1  Summary  of  1987 

Research  on  the  Versatile  Maintenance  Expert  System  (VMES)  project  is  concerned  with 
issues  in  the  development  of  a  system  that  could  diagnose  faults  in  an  electronic  circuit  and 
interact  with  a  maintenance  technician.  EXiring  1987  our  research  on  this  project  had  two  dis¬ 
tinct  but  overlapping  phases:  consolidation  of  work,  done  during  the  previous  two  years  and 
developing  new  directions  of  research.  ‘  T 

In  the  first  phase  we  emphasized  several  aspects  of  versatility.  The'aspects  of  "versatil¬ 
ity"  originally  defined  by  the  VMES  project  included:  ability  to  diagnose  a  device  that  has  bee£” 
designed  so  recently  that  there  has  not  been  time  to  train  technicians  in  its  diagnosis;  ability  lo 
diagnose  a  device  that  is  so  experimental  that  it  has  not  been  cost  effective  to  design  extensive 
automatic  testing  systems;  ability  to  diagnose  a  wide  range  of  devices  from  a  similar  family  of 
devices;  ability  to  serve  at  various  maintenance  levels  (field,  depot,  etc.);  ability  to  interact  flexi¬ 
bly  and  in  a  "user-friendly"  fashion.  Significant  achievements  of  the  first  phase  of  the  VMES 
project,  all  of  which  were  consolidated  in  the  first  half  of  1987,  were  in  the  area  of  device 
representation  and  fault  diagnosis.  These  were:  development  of  an  improved  diagnostic  strategy 
that  uses  suspect  ordering  criteria,  introduction  of  a  new  model  of  connections  that  enables 
VMES  to  diagnose  connection  problems  such  as  interrupted  wires  and  bad  contact  points,  and 
incorporation  of  both  logical  and  physical  device  models  to  ease  user  interaction  and  speed  up 
diagnosis. 

In  the  second  phase  of  our  work  we  began  to  design  an  improved  system  which 
emphasizes  the  interactions  between  the  logical  and  physical  models.  Tliis  was  made  possible 
by  our  acquisition  of  an  actual  working  physical  device.  We  also  began  to  explore  how  to 
accommodate  analog  components,  in  addition  to  the  digital  components  previously  handled.  A 
more  complex  control  structure  to  handle  diagnosis  at  different  levels  of  knowledge  began  to 
take  shape. 
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2A.2  PHASE  1:  DEVICE  REPRESENTATION  AND  FAULT  DIAGNOSIS’ 


The  major  achievements  of  the  VMES  project  in  the  first  phase  are  in  the  areas  of  device 
representation  and  fault  diagnosis.  These  were:  the  diagnostic  strategy  was  improved  by  using 
more  effective  suspect  ordering  criteria,  a  new  model  of  connections  was  introduced  to  enable 
VMES  to  diagnose  connection  problems  such  as  interrupted  wires  and  bad  contact  points,  and 
both  logical  and  physical  device  models  were  incorporated  to  ease  user  interaction  and  to  speed 
up  diagnosis.  The  remainderof  this  section  expands  upon  these  three  topics. 

2A^1  Suspect  Ordering 

Suspects  are  first  sorted  into  sublists  by  global  criteria  called  fault  possibilities.  Fault  pos¬ 
sibility  is  determined  by  evaluating  the  suspects  against  the  overall  current  situation,  which 
consists  of  the  current  test  results.  For  the  current  implementation,  there  is  only  one  global  cri¬ 
terion:  a  suspect  has  higher  fault  possibility  if  it  contributes  to  more  vio-expct  output  ports. 
Suspects  within  each  sublist  are  then  sorted  by  some  local  criteria  called  fault  potenticdkies. 
Fault  potentiality  is  a  measure  of  the  rate  a  particular  type  of  component  may  fail.  It  is 
independent  of  the  environment,  depending  only  on  the  component  type.  (It  may  also  depend 
on  the  lot  number  of  the  component,  but  so  far  we  do  not  treat  such  details.)  The  ideal  fault 
potentiality  data  for  our  domain  is  the  thermal  analysis  data  of  the  components.  Due  to  the 
unavailability  of  the  thermal  analysis  data,  it  is  now  implemented  as  an  index  ranging  from  1 
to  3.  Component  types  with  no  stored  fault  potentiality  data  default  to  2. 

VMES  does  not  make  the  single  fault  assumption.  The  system  incorporates  the  user’s 
judgement  by  offering  him  an  opportunity  to  terminate  the  diagnosis  session  whenever  a  faulty 
part  is  located.  The  user  can  choose  to  continue  the  investigation  of  the  remaining  suspects  if 
he  feels  that  more  faults  are  possible  or  if  he  would  merely  like  to  make  sure  other  suspects 
have  no  problems.  The  user  may  have  another  opportunity  to  terminate  the  diagnosis  when 
VMES  notices  a  diagnostic  short-cut  from  the  du^  device  model  is  present;  this  wUl  be  dis¬ 
cussed  in  the  section  of  ‘Dual  Device  Model”. 

2A,2.2  Modeling  Connections 

Model-based  circuit  diagnosis  isolates  the  faulty  components  of  a  malfunctioning  elec¬ 
tronic  device  by  reasoning  on  the  basis  of  structural  and  functional  description  of  the  device. 
In  this  part  of  our  work,  we  argue  that  explicit  representation  of  wires  and  points  of  contact 
(POCONs)  is  necessary  for  diagnosing  faults  of  circuit  connections.  The  traditional  model  of  a 
wire  as  a  uni-directional  module  is  inappropriate  because  it  ignores  the  bi-directional  nature  of 
a  wire  and  does  not  include  POCONs.  A  new  model  of  wires  and  POCONs  and  the  correspond¬ 
ing  semantic  network  representation  are  devised  and  implemented.  A  wire  is  modeled  as  a  bi¬ 
directional  module  to  preserve  its  physical  property,  and  its  uni-directional  design  intention  is 
retained  by  the  connection  mechanism.  A  deliberate  component  connection  mechanism  -  either 
by  forming  a  POCON  from  two  different  ports  or  superimposing  two  same  ports  together  -  is 
also  devised  and  implemented.  In  this  new  connection  mechanism,  components  at  different 
hierarchical  levels  are  linked  together  by  port  superimposition,  and  components  at  the  same 
hierarchical  level  are  linked  by  POCON  formation.  The  new  wire  model  and  connection 
mechanism  are  effective  in  circuit  simulation  and  fault  diagnosis.  The  resultant  VMES  has 
been  successful  in  locating  interrupted  wires  and  bad  contact  points,  and  as  has  been  discussed, 


'Thii  section  is  s  sununsry  of  the  following  pspers:  Taie,  M.  R,  Geller,  J,  Srihari.  S.  N,  Shapiro,  S.  C,  “Knowledge 
Baaed  Modeling  of  Grcuit  Boards”,  in  Proc.  of  RAMS-87,  Jan.  1987;  Taie,  M.  R.  and  Srihari,  S.  N..  “Modeling  Connections 
for  Qrcuit  Diagnosis”,  in  Proc.  of  tht  3rd  IEEE  CAI A,  Feb.  1987;  and  Geller,  J.,  Taie,  M.  R.,  Shapiro.  S.  C,  Srihari.  S.  N, 
“Device  represenution  and  Graphics  Interfaces  of  VME^.  in  Proc.  of  the  2nd  International  Ccnf  on  Applications  of 
AI  in  Engineering,  Aug.  1987.  2 A-  7 


the  new  connection  model  makes  it  is  possible  to  handle  bridge  problems  to  a  limited  extent. 

2A.23  Dual  Device  Models 

Human  diagnosticians  of  electronic  devices  seem  to  simultaneously  maintain  models  of  the 
logical  and  physical  structures  of  the  target  device.  They  carry  out  most  of  the  diagnostic  rea¬ 
soning  over  the  logical  structure  of  the  device  due  to  its  functional  association.  While  carrying 
out  the  reasoning,  the  logical  structure  is  apparently  mapped  to  the  physical  structure  from 
time  to  time.  Tests  and  measurements  are  hrst  initialized  using  the  logical  structure,  and  are 
then  realized  and  executed  on  the  physical  structure.  Repair,  which  is  usually  done  by  replac¬ 
ing  a  physical  unit  or  by  fixing  a  physical  connection,  is  planned  and  done  on  the  physical 
structure.  In  other  words,  maintenance  technicians  use  a  model  of  physical  structure  of  the  tar¬ 
get  device,  which  is  a  hierarchically  arranged  set  of  replaceable  physical  components  at  various 
maintenance  levels  such  as  field-level  and  depot-level.  By  mapping  the  logical  structure  of  the 
device  to  its  physical  equivalent,  maintenance  technicians  are  able  to  terminate  the  diagnostic 
process  at  the  right  moment  and  to  form  an  adequate  repair  plan. 

CHven  that  the  mapping  between  the  logical  structure  of  the  device  and  its  physical 
equivalent  happens  throughout  the  diagnostic  process  at  all  hierarchical  levels,  the  speed  in  car¬ 
rying  out  the  mapping  is  critical  to  the  time  needed  to  locate  faults.  This  implies  that  objects 
on  both  the  logical  structure  and  the  physical  structure  of  the  device  should  be  closely  li^ed 
to  each  other  so  that  the  mapping  is  done  efficiently.  Even  experienced  technicians  may  have 
difficulty  in  locating  a  point  on  a  schematic  diagram  of  the  real  device,  where  the  schematic 
diagram  represents  the  logical  structure  of  the  device,  and  the  form  of  the  real  device  is  the 
physical  structure.  This  difficulty  is  anributable  to  the  large  difference  between  the  logical  and 
the  physical  structures  and  a  lack  of  cross-links  at  all  hierarchical  levels  of  the  device  in 
human  memory.  On  the  other  hand,  when  modeling  and  representing  a  device  in  an  automatic 
fault  diagnosis  system,  the  cross-Uiiks  between  its  logical  structure  and  physical  structure  can 
be  modeled  and  represented  to  an  appropriate  level  of  detaU.  This  is  indeed  possible  to  do  in  a 
computer  with  reasonably  sized  memory. 

In  VMES,  the  ph3rsical  structure  of  a  device  is  represented  distinctly  from  but  in  a  similar 
way  as  its  logical  structure.  In  a  structural  template  for  a  logical  component  type,  every  sub¬ 
part  of  the  component  t3rpe  is  specified  with  a  subpart  “id”  and  a  subpart  “type”,  which  are 
used  to  inistantiate  the  subpart  if  it  is  found  to  be  a  suspect  and  further  investigation  of  it  is 
necessary.  In  addition  to  ^e  subpart  “id”  and  “type”,  an  “mntn-lv”  indicator  is  also  associated 
with  every  subpart  of  a  physical  component  type.  The  “mntn-lv”  indicator  shows  the  intended 
maintenance  level  of  the  subpart,  Le.,  the  maintenance  level  where  the  suopart,  if  found  faulty, 
is  replaced  without  further  diagnosis.  The  “mntn-lv”  indicator  is  associate  with  the  ph3rsical 
structure  rather  than  the  logical  structure  of  a  device  to  reflect  the  fact  that  human  experts 
form  and  carry  out  a  repair  plan  based  on  a  ph3rsical  model  rather  than  a  logical  model  of  the 
device. 

In  order  to  abstract  a  device  into  a  model,  which  can  be  efficiently  represented  and  inter¬ 
preted,  some  abstraction  restrictions  have  to  be  made.  First,  the  hierarchical  trees  abstracted 
from  the  two  perspectives  should  have  the  same  number  of  hierarchical  levels.  Second,  the 
cross-links  can  only  be  made  at  the  same  hierarchical  leveL  Third,  several  logical  objects  on  the 
logical  structure  can  correspond  to  the  same  ph3rsical  object  on  the  physical  tree,  but  a  logical 
object  cannot  spread  over  several  physical  objects.  This  restriction  seems  unreasonable  at  first, 
but  a  closer  investigation  of  the  electronic  domain  shows  the  contrary  —  physical  objects  in  the 
domain  usually  have  larger  grain  size  than  logical  objects.  This  is  especially  true  with  modem 
technology  as  more  and  more  logical  functioning  units  are  being  packed  into  a  physical  unit, 
e.g.,  a  simple  Hexinverter  chip  (a  ph3rsical  object)  contains  six  independent  inverters  (logical 
objects).  2A-8 


The  two  representations  of  the  logical  and  the  physical  structures  of  a  device  are  cross- 
linked  at  every  hierarchical  levels.  There  are  two  kinds  of  cross-links  between  the  logical 
structure  and  the  physical  structure  of  a  device.  The  first  kind  are  cross-links  for  components. 
The  second  kind  are  cross-links  for  ports.  While  the  cross-links  of  components  helps  in  deter¬ 
mining  if  the  diagnostic  process  should  go  on  or  terminate,  and  in  forming  a  repair  plan,  the 
cross-links  of  ports  makes  user  interaction  much  easier  —  when  ordering  a  test  or  a  measure¬ 
ment,  it  can  be  used  to  clearly  direct  the  user  to  the  right  location  on  the  real  device.  The 
advantage  of  a  logical  abstraction  of  the  device  is  that  it  provides  a  high  level  view  of  the  dev¬ 
ice  which  facilitates  the  diagnostic  reasoning.  For  instance,  a  n-bit  wire  is  abstracted  as  a  single 
logical  wire,  thus  freeing  the  technician  (or  a  fault  diagnosis  system)  from  thinking  about  bit 
slices.  However,  when  a  measurement  is  required,  it  is  necessary  to  locate  all  the  bit-ports  on 
the  real  device,  and  this  is  often  a  difficult  task  for  human  diagnosticians  since  these  bit-ports 
may  spread  out  randomly. 

In  the  rest  of  this  section,  we  describe  how  VMES  uses  this  device  representation  to  facili¬ 
tate  fault  diagnosis  and  user  interaction.  When  bad  outputs  are  found  in  the  suspect  currently 
being  investigated,  the  system  has  to  determine  if  the  diagnosis  should  terminate  or  not.  Most 
fault  diagnosis  systems  use  the  simple  idea  of  SRU  (smallest  replaceable  unit)  which  says  that 
the  diagnostic  process  stops  when  the  current  suspect  is  a  SRU,  i.e,,  a  terminal  node  (a  leaf)  of 
the  structural  hierarchical  tree  of  the  device  VMES  takes  a  more  flexible  approach  by  incor¬ 
porating  the  idea  of  "intended  maintenance  level"  into  the  system.  A  system  parameter, 
VMESJML,  is  set  to  the  “intended  maintenance  level”  the  system  is  working  on.  If  a  part 
shows  some  bad  outputs  and  it  is  at  the  intended  maintenance  level,  it  is  declared  faulty  and 
the  diagnosis  on  it  is  terminated.  For  example,  a  board  is  replaced  at  field  and  then  sent  back  to 
a  depot  where  the  fault  is  further  isolated  to  a  chip.  The  checking  for  the  maintenance  level 
of  a  part  is  done  on  the  corresponding  physical  object  of  the  part  (a  logical  object),  and  a  repair 
plan  is  formed  baaed  on  the  component  type  of  the  physical  object.  VMES  also  provides  an 
opportunity  for  the  user  to  short-cut  the  diagnosis  by  noticing  that  all  remaining  (logical) 
suspects  are  in  a  single  replaceable  physical  unit  at  VMESJML.  Since  the  same  physical  object 
gets  replaced  no  matter  which  logical  suspect  is  faulty,  further  discrimination  among  the 
suspects  is  unnecessary,  provided  that  connections  are  assumed  to  be  intact. 

The  major  interaction  between  VMES  and  the  user  is  the  input  of  port  values.  Since  diag¬ 
nostic  reasoning  is  carried  out  on  the  logical  model  of  the  device,  VMES  always  wants  the 
values  of  the  logical  ports.  Through  the  cross-links  between  logical  and  the  physical  structures, 
VMES  is  able  to  inform  the  user  which  "ph3rsical  port”  should  be  measured  to  obtain  the  value 
for  a  given  logical  port.  For  representation  and  display  efficiencies,  wires  are  excluded  from  the 
physical  representation  of  a  device;  this  does  not  hurt  the  user  interaction  since  the  wire-end  of 
a  wire  can  always  be  identified  as  the  wire-end  coimected  to  a  port  of  a  common  component  in 
the  ph3rsical  representation. 

The  third  use  of  the  physical  representation  of  a  device  is  in  repair  suggestions.  When  a 
faulty  object  is  found  or  the  end  of  the  diagnosis  session  is  reached,  VMES  suggests  a  repair 
plan  to  the  user  according  to  the  type  of  the  faulty  object.  If  the  faulty  object  is  a  common 
component,  VMES  just  suggests  that  the  user  replace  its  corresponding  physical  part  If  it  is  a 
wire,  the  corresponding  physical  wires  are  identified  for  repair.  Note  that  a  logical  wire  may 
correspond  to  several  physical  wires,  for  example,  a  4-bit  logical  wire  may  be  realized  by  four 
wires  on  a  printed  circuit  board.  Only  the  physical  wires  which  are  responsible  for  the  fault 
are  identified  for  repair.  This  is  done  by  decomposing  the  port  value  of  a  logical  wire  into  bit 
slices  to  determine  which  bit(s)  are  giving  incorrect  values.  Finally,  if  the  faulty  object  is  a 
POCON,  that  is,  it  is  a  bad  contact  point,  the  user  is  directed  to  the  location  of  the  conuct  point. 
The  physical  representation  is  not  only  used  to  form  the  repair  plan,  it  also  helps  direct  the 
user  to  the  object  or  location  on  the  real  device  where  the  repair  is  actually  performed.  In 
other  words,  it  provides  for  better  user  interaction  in  both  test  and  repair. 
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2AJ  PHASE  2:  A  NEW  DIAGNOSTIC  ARCHITECTURE 


This  section  explores  the  new  areas  and  directions  of  the  VMES  project,  and,  by  contrast¬ 
ing  them  with  those  of  the  existing  system,  exhibits  the  reasons  for  pursuing  those  areas  and 
directions.  The  following  details  the  progress  of  the  current  research  assisunts  on  the  V'MES 
project  since  August. 

The  first  month  (August)  was  devoted  almost  entirely  to  learning.  A  number  of  back¬ 
ground  papers  on  fault  diagnosis  were  read  and  Mingruey  Taie’s  recent  dissertation  was  studied 
in  depth.  From  these  readings  much  was  learnt  about  fault  diagnosis  in  general  and  the  exist¬ 
ing  implementation  in  particular.  A  working  knowledge  of  SNePS,  which  is  used  extensively 
in  the  implementation,  and  of  the  updated  version  SNePS  II,  which  is  to  be  used  in  the  future 
implementation,  was  also  acquired. 

As  soon  as  there  was  sufficient  familiarity  with  the  existing  implementation,  a  new  dev¬ 
ice  from  the  ACTS  system  was  selected  for  implementation.  A  device  was  wanted  which  was 
sufficiently  similar  to  the  already  implemented  PCM6  board  so  as  to  be  able  to  be  implemented 
without  modifying  the  existing  system,  but  which  would  still  afford  an  adequate  a  test  of  the 
system  robustness.  The  valuable  experience  of  implementing  a  new  device  was  also  a  major 
consideration.  The  PCM4  board  was  selected.  This  board  had  three  new  types  of  digital  and 
two  new  types  of  analogue  component  and  thus  would  test  the  ability  of  the  system  to  handle 
new  components.  The  decision  was  partly  influenced  by  the  fact  that  there  was  a  picture  of 
the  physical  PCM4  board.  Access  of  some  kind  to  the  nature  of  the  physical  device  was  impor¬ 
tant  since  there  had  already  arisen  the  intention  to  make  greater  use  of  the  distinction  between 
the  logical  and  the  physical  representations  of  a  device  employed  by  the  existing  system. 

As  preparation  to  implementing  the  PCM4  board,  it  was  decided  to  implement  a  very 
small  device.  A  half  adder  was  chosen  and  was  implemented  quite  quickly.  TTie  implementa¬ 
tion  of  the  PCM4  board  itself  has  just  recently  been  completed.  These  implementations  pro¬ 
vided  much  information  about  what  the  system  could,  and  could  not,  do.  From  the  knowl^ge 
acquired  from  the  readings  and  the  experience  of  the  implementation,  an  overall  plan  for  modi¬ 
fying,  upgrading  and  extending  the  system  evolved. 

The  new  system  to  be  built  will  begin  with  the  knowledge  representation  used  by 
Mingruey  Taie  and  the  control  structure  developed  by  Zhigang  Xiang.  It  was  deemed  impor¬ 
tant  to  have  continual  access  to  an  actual  physical  device  while  developing  the  new  system  so 
that  greater  account  can  be  made  of  the  physical  representation.  A  physic^  device  -  a  Heath- 
kit  Prin.ter  Buffer,  Model  SK-203  -  was  therefore  purchased  and  assembled.  Three  general 
areas  on  which  detailed  work  needs  to  be  done  have  emerged: 

(1)  The  refinement  and  adaptation  of  Xiang’s  general  diagnostic  architecture  to  the  particu¬ 
lar  domain  of  circuit  diagnosis.  A  control  structure  needs  to  be  developed  which  will 
allow  a  more  modular  approach  to  the  different  kinds  of  circuit  that  are  to  be  handled. 
If  the  more  complex  system  to  be  built  is  to  handle  a  greater  variety  of  fault  efficiently, 
a  significantly  more  complex  control  structure  is  required.  Such  a  structure  must  have 
the  capacity  to  respond  dynamically  to  the  diagnostic  process.  Integrated  into  this  struc¬ 
ture  will  be  a  sub-structure  controlling  the  repair  strategy. 

(2)  The  adaptation  of  the  current  means  of  knowledge  representation  developed  by  T2ue  to 
the  new  system.  That  representation  is  to  be  extended  significantly  so  as  to  accommo¬ 
date  analogue  components  in  general,  and  sequential  rather  than  just  combinational  cir¬ 
cuits. 

(3)  The  improvement  of  the  means  of  reasoning  about  the  knowledge  representation  system 
in  general,  and  especially  about  the  means  of  generating,  ordering  and  eliminating  the 
fault  suspects.  It  is  hoped  that  use  can  be  made,  via  the  knowledge  representations,  of 
the  natures  of  individual  components,  rather  than  of  just  the  interconnections  between 
them.  Other  methods  of  improvement  must  be  explored  also. 
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2A3.1  Modularity  of  the  Implementation 

One  of  the  important  characteristics  for  the  new  implementation  of  VMES  is  modularity. 
We  envision  a  system  with  several  different  types  of  reasoning  techniques.  For  example,  there 
may  be  specialized  techniques  for  eliminating  suspects  in  analog  circuits  that  are  not  appropri¬ 
ate  for  combinational  digital  circuits.  It  would  be  desirable  to  be  able  to  just  use  the  portions  of 
the  system  that  are  needed  to  diagnose  the  given  device,  rather  than  having  the  entire  system  in 
memory  and  only  using  a  small  portion.  This  is  attractive  because  it  is  space  efficient. 

The  existence  of  reasoning  modules  that  can  be  requested  by  the  user  either  when  a  diag¬ 
nosis  is  started  or  even  in  the  midst  of  a  session  is  attractive  from  the  experimental  stand  point 
as  well.  If  specialized  modules  are  designed,  they  can  be  tested  with  a  ''minimal"  system 
configuration  that  will  prevent  other  modules  from  interfering  with  the  new  mcxiule.  If 
conflicts  do  arise  between  modules,  the  problems  can  be  located  by  removing  possible  "suspect" 
modules  untU  the  problems  are  resolved  and  then  focusing  on  the  set  of  suspect  modules  that 
give  rise  to  the  observed  problems. 

The  idea  of  a  minimal  S3rstem  is  that  there  are  some  set  of  modules  that  are  necessary  for 
the  system  to  do  any  work.  The  modules  in  a  minimal  system  would  include  input  and  output 
routines,  routines  to  build  the  required  device  representations,  the  basic  diagnostic  reasoning 
modules,  and  a  simple  routine  to  guide  the  system  toward  a  completed  diagnosis. 

Another  key  feature  that  modularity  adds  is  expandability.  Because  a  protocol  must  be 
established  between  the  modules  in  the  system,  a  clear  and  concise  method  of  adding  new 
modules  should  develop.  When  this  occurs,  you  not  only  have  an  environment  suitable  to  test 
new  modules,  but  also  an  environment  suited  to  developing  new  modules. 

2AJ^  Types  of  Circuits 

Roughly,  there  are  three  types  of  electronic  circuits  -  analog,  combinational  and  sequen¬ 
tial  circuits.  Each  type  has  its  own  characteristics;  for  example,  combinational  circuits  have 
simple  logical  signals  (0  &  1),  analog  circuits  must  consider  current  in  addition  to  voluge,  and 
sequential  circuits  have  an  extra  time  aspect.  Hence,  different  types  of  knowledge  and  methods 
of  diagnostic  reasoning  are  needed  for  different  types  of  circuits.  The  knowledge  representation 
primitives  and  diagnostic  rules  the  current  system  provides  are  good  for  combinational  circuits 
but  it  is  not  clear  how  to  use  the  current  system  for  general  circuits  of  the  other  two  types. 
Since  analog  and  sequential  circuits  exist  in  most  electronic  devices,  it  is  desirable  to  extend  the 
current  system  to  handle  them. 

Analog  circuits 

In  addition  to  voltage,  current  plays  an  important  role  in  analog  circuits.  Their  behavior 
is  described  by  Ohm’s  law  and  KirchhofTs  current  and  voltage  laws.  In  order  to  diagnose  an 
analog  circuit,  all  the  above  knowledge  must  be  represented  in  such  a  way  that  the  s3rstem  can 
use  it  to  anal3^  the  circuit  and  derive  helpful  information. 

The  major  difficulty  in  knowledge  representation  for  analog  circuits  is  representing  sig¬ 
nals.  Unlike  the  digital  domain,  the  analog  domain  has  a  richer  set  of  signals  and  most  of  them 
are  continuous.  For  example,  we  have  to  represent  input  and  output  waveforms  and  the  sys¬ 
tem  must  be  able  to  compare  and  manipulate  them.  All  these  are  currently  under  investiga¬ 
tion. 

Sequential  circuits 

A  sequential  circuit  is  specified  by  a  time  sequence  of  external  inputs,  external  outputs 
and  internal  states.  The  external  outputs  are  functions  of  both  the  external  inputs  and  the 
present  state  of  the  circuit.  The  next  state  of  the  circuit  is  also  a  function  of  its  present  state 
and  external  inputs.  Current  functional  representation  does  not  include  the  time  dimension  and 
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thus  needs  to  be  extended. 

We  are  considering  a  hierarchic  representation  for  time  so  that  functions  can  be 
represented  at  different  levels  of  time  hierarchy.  In  other  words,  the  behavior  of  a  sequential 
circuit  is  described  using  different  granularities  of  time.  As  a  result,  sequential  circuits  can  be 
diagnosed  at  various  levels  of  time  hierarchy  in  a  way  similar  to  the  use  of  structural  hierar¬ 
chy  is  used  in  combinational  circuits  currently. 

2A33  Suspect  Handling 

One  of  the  key  components  of  the  VMES  system  is  the  way  the  fault  suspects  are  han¬ 
dled.  From  the  measured  values  of  the  various  ports  and  the  functions  representing  the  com¬ 
ponents  in  question,  those  output  ports  which  are  vio-expects  are  found;  i.e.,  those  whose  value 
violates  what  would  be  expected  on  the  strength  of  the  measured  values  and  the  component 
functions.  Given  the  vio-expect  output  ports,  there  are  are  three  main  tasks  to  be  accomplished; 
namely, 

(a)  The  initial  generation  of  the  fault  suspects,  of  the  list  of  all  those  component  parts  that 
would,  if  they  were  faulty,  account  for  the  observed  fault  or  faults, 

(b)  The  ordering  of  those  suspects  according  to  the  likelihood  of  their  being  responsible  for 
the  observed  fault(s). 

(c)  The  subsequent  elimination  of  those  suspects  that  in  fact  are  not  faulty,  by  the  testing  of 
the  components  in  question. 

The  Current  System 

These  three  tasks  are  handled  by  the  current  VMES  system  in  the  following  way: 

(a)  The  suspects  are  generated  by  locating  all  those  components  which  have  an  output  (or  bi¬ 
directional)  port  leading  to  a  vio-expect  output  port.  For  example,  if  II  and  12  are  the  sole 
input  ports  of  the  eventtial  output  port  0,  if  Cl  -  Cn  are  the  components  lying  bf-ween 
either  II  and  O  or  12  and  O,  and  if,  given  the  values  of  II  and  12  and  the  functions 
representing  Cl  -  Cn,  O  is  a  vio-expect,  then  every  component  Cl  -  Cn  becomes  a  susj  ect 

(b)  The  order  of  the  suspects  is  determined  by  the  global  criterion  that  the  more  vio-eipe '  s  a 
suspect  contributes  to,  the  more  likely  it  is  that  it  is  faulty.  (A  local  criterion  >  .at 
applies  to  suspects  having  the  same  global  likelihood  of  being  faulty  has  been  propatd 
but  has  not  been  implemented.) 

(c)  Suspects  are  tested  in  the  order  of  their  likelihood  of  being  faulty.  The  tests  employ  the 
existing  values  of  the  suspect’s  ports,  and  if  these  values  are  consistent  with  the  suspect’s 
function,  it  ceases  to  be  a  suspect. 

The  New  System 

Considerable  improvements  are  envisaged  for  each  of  the  three  main  tasks.  Overall,  more 
reasoning  about  the  nature  of  the  device,  its  components,  and  the  connections  between  its  com¬ 
ponents  is  desired. 

One  important  kind  of  reasoning  being  explored  is  a  qualitative  reasoning  that  exploits  a 
deep  knowledge  of  the  device.  Knowledge  of  this  general  kind  is  already  represented  by  the 
system.  A  human  technician  will  ask  himself  whether  the  kind  of  fault  he  is  observing  is 
likely  to  be  caused  by  a  component  of  a  given  type,  whether  a  failure  of  that  component  is 
likely  to  produce  the  observed  fault.  Here,  he  will  make  considerable  use  of  his  knowledge  of 
how  the  device  components  function,  and  of  the  inter-connections  between  them.  But  he  will 
not  in  general  perform  detailed  or  quantitative  calculations  about  the  various  components  at 
this  stage  of  the  diagnosis.  Rather,  he  rely  on  comparisons  and  considerations  of  a  more  qualita¬ 
tive  kind.  (He  may,  of  course,  resort  to  detailed  quantitative  calculations  at  a  later  stage  of  the 
diagnosis.)  It  is  in  this  sense  that  the  reasoning  is  said  to  be  qualitative. 

2A-13 


The  primary  motivations  for  developing  a  reasoning  system  of  the  qualitative  kind  are 
these.  First,  since  human  technicians  proceed  in  more  or  less  this  way,  there  is  every  reason  to 
believe  that  the  methods  will  yield  quite  a  powerful  diagnostic  system.  And  second,  the  com¬ 
putational  overhead  of  such  a  system  is  considerably  less  than  that  of  a  comparable  system  that 
relies  on  purely  quantitative  reasoning. 

The  new  diagnostic  system  is  dealing  with  the  three  main  tasks  as  follows: 

(a)  Two  methods  of  suspect  generation  are  being  examined.  The  first  uses  the  kind  of  qualita¬ 
tive  reasoning  about  the  nature  of  the  devices  outlined  above.  In  the  second,  the  diagnos¬ 
tic  83rstem  will  request  the  user  to  measure  the  values  at  certain  ports.  Just  which  ports 
are  measured  is  determined  by  the  system.  The  measured  ports  are  those  that  are  logically 
intermediate  between  the  input  and  output  ports  of  which  the  values  are  already  known 
by  the  system.  In  this  way  the  system  will  home  in  on  the  trouble  area  more  efficiently; 
large  segments  of  the  device  can,  at  least  initially,  be  excluded. 

(b)  The  ordering  of  the  suspects  is  particularly  well  suited  to  the  qualitative  reasoning 
approach.  Other  considerations  will,  of  course,  also  be  used.  For  example,  the  current 
method  of  ordering  (mentioned  earlier)  will  be  retained,  though  it  will  now  just  be  one  of 
the  factors  that  affects  the  suspect  order.  There  is  an  interesting  problem  of  how  different 
ordering  criteria  are  to  be  compared  to  yield  the  final  suspect  list. 

(c)  The  kinds  and  numbers  of  tests  to  which  a  suspect  is  to  be  subjected  is  to  be  improved. 
The  current  S3rstem  emplo3r8  a  single  test  whereas,  in  general,  a  number  of  tests  is  needed 
to  eliminate  a  suspect.  These  tests  should  be  sufficiently  diverse  to  make  it  extremely 
likely  that  if  the  component  passes,  it  is  not  faulty. 

2A3A  New  Test  Device 

Although  this  project  is  intended  to  develop  a  system  that  is  adaptable  to  a  wide  range  of 
devices  in  the  domain  of  digital  circuits  without,  at  times,  focusing  on  a  specific  device,  this 
seems  a  hopeless  task.  By  studying  the  problem  of  diagnosing  faults  in  several  specific  devices 
and  keeping  the  goal  of  versatility  in  mind,  we  should  discover  the  constraints  and  methods 
needed  to  attack  this  problem  more  readily  than  if  we  were  to  study  just  one  or  two  devices. 
Several  devices  have  been  modeled  by  the  current  implementation  of  VMES. 

A  new  device  was  needed  to  help  spur  new  ideas,  extensions  and  refinements  to  the 
current  theory.  A  primary  concern  was  t^t  the  researchers’  actually  have  a  small  piece  of 
hardware  to  motivate  the  theory,  rather  than  just  schematics  and  pictures.  After  pursuing  the 
possibility  of  using  a  piece  of  RADC  equipment,  it  was  suggested  that  we  select  an  appropriate 
test  device  and  purchase  it. 

The  following  criteria  were  used  to  select  the  device: 

•  reasonably  priced  (<  $500.00) 

•  contains  combinational  circuitry 

•  contains  sequential  circuitry 

•  contains  analog  circuitry 

•  contains  a  variety  of  component  types 

•  contains  many  logical  components  (>50) 

•  can  be  subdivided  into  several  subdevices 

The  new  test  device  that  was  selected  was  a  Heathkit  Printer  Buffer  Kit  (model  SK-203). 
In  addition  to  satisfying  the  previously  mentioned  criteria,  the  device  came  with  the  circuit 
schematics,  circuit  beard  x-ray  views  that  phyacally  locate  the  components,  an  operation  guide, 
the  device  specifications,  some  basic  troubleshooting  information,  and  block  diagrams  that  are 
helpful  in  understanding  the  circuitry  and  components. 

There  is  one  other  advantage  worth  mentioning  about  this  device.  Since  we  built  the 
printer  buffer  from  a  kit  we  know  more  about  its  physical  construction  than  we  have  about 
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any  of  the  other  test  devices.  Because  of  this  and  the  fact  that  we  actually  have  the  physical 
device,  we  can  cause  faults  in  the  device  by  removing  or  "damaging"  components  in  a  number 
of  ways.  Then  we  can  use  our  implementation  of  VMES  to  diagnose  the  fault.  Previously, 
testing  an  implementation  of  a  device  meant  "damaging"  a  logical  component  in  the  representa¬ 
tion  and  using  VMES  to  locate  that  logical  device.  There  was  no  physical  device  to  check,  the 
diagnosis  on.  Now,  we  perform  a  more  realistic  test  of  our  implementation  by  "damaging"  a 
physical  component  (or  more  than  one)  and  giving  VMES  the  symptoms  of  the  device.  This 
gives  us  a  much  richer  test  device. 

Physical  Description 

Model  SK-203  printer  buffer  is  enclosed  in  a  sheet  metal  housing  with  the  front  and  rear 
panels  exposing  the  controls  and  fixtures.  The  enclosure  itself  is  9.25  inches  wide,  1.5  inches 
high  and  8  inches  deep.  It  weighs  approximately  1.5  pounds.  On  the  front  panel,  as  depicted  in 
Figure  1,  are  11  pushbutton  switches  (including  for  both  input  ports  [l]  a  clear  key,  [2]  a  copy 
key,  [3]  a  priority  print  key,  [4]  a  restart  key,  and  [5]  an  offline  key,  plus  [6]  a  single  swap  key), 
three  7-segment  LED  displays  and  an  LED  above  the  "Swap"  pushbutton.  The  arrangement  of 
these  parts  are  shown  in  Figure  1.  FRONT- AND-REAR. 
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Also,  there  is  an  external  transformer  that  plugs  into  a  120  VAC  wall  recepucle  and  outputs  8 
VAC  1  amphere  to  a  plug  that  mates  with  the  power  jack  on  the  rear  panel. 

Within  the  enclosure  are  two  circuit  boards  connected  by  two  20-pin  right  angle  plugs. 
The  smaller  circuit  board  mounts  all  of  the  components  that  are  visible  in  the  front  panel  of 
the  enclosure.  The  main  circuit  board  mounts  the  rest  of  the  components  of  the  printer  buffer. 
This  includes  a  64180  CMOS  microprocessor,  eight  64K  x  1  bit  dynamic  RAMs,  an  8K  ROM, 
and  many  logic  and  decoder  ICs.  In  addition  to  these  digital  components  there  are  various  resis¬ 
tors,  capacitors,  diodes,  and  inductors  that  give  us  the  analog  components  of  the  circuit. 

Operational  Description 

The  model  SK'203  printer  buffer  will  accept  files  from  one  or  two  computers  and  print 
them  to  one  or  two  printers.  By  using  a  combination  of  the  Swap  key  (pushbunon  switch)  and 
the  Offline  keys  all  the  reasonable  configurations  can  be  achieved. 

Some  of  the  other  features  of  the  SK-203  printer  buffer  are: 

•  expandable  memory  up  to  512  Kbytes 

•  ability  to  print  up  to  99  copies  of  a  file 

•  allows  the  user  to  stop  a  current  job  to  print  another  job  and  then  resume  the  stopped  print 
job 

•  the  user  can  restart  the  printing  of  a  file  in  case  of  printer  failure 

•  both  the  parallel  and  se^  ports  are  configurable  by  DIP  switch  settings 

A  complete  description  of  the  operation  of  the  SK-203  printer  buffer  is  available  in  the 
"Hcathkit  Manual  for  the  PRINTER  BUFFER  Model  SK-203",  part  number  595-3727-01. 
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2AA  DEVELOPMENT  OF  SNePS-2 

Most  of  this  year  has  been  spent  on  the  development/upgrade  of  the  Semantic  Network 
Processing  System  (SNePS)  for  use  with  Texas  Instruments  Explorers  and  Symbolics  Lisp 
Machines.  The  current  complete  version  of  SNePS,  commonly  referred  to  as  SNePS79,  is  imple¬ 
mented  in  Franz  Lisp,  Opus  38.92  and  currently  running  on  Digital  Equipment’s  VAX 
750/780/785  family  of  computers.  The  new  version  of  SNePS  currently  under  development, 
commonly  referred  to  as  SNePS-2,  has  been  chosen  as  the  vehicle  upon  which  the  Versatile 
Maintenance  Expert  System  (VMES)  is  to  be  implemented. 

The  development  of  SNePS-2  has  been  essentially  broken  down  into  two  steps.  The  first 
step  has  been  translating  the  SNePS  code  from  Franz  Lisp  into  Common  Lisp  —  the  language 
used  on  lisp  machines.  The  second  step  is  then  the  debugging  of  the  new  system  in  the  com¬ 
pletely  new  environment  of  the  Usp  machine. 

2Av4.1  Motivatioii 

In  the  summer  of  1986,  Ernesto  Morgado^  and  the  SNePS  Research  Group  completed  the 
core  of  a  new  version  of  SNePS,  also  implemented  in  Franz  Lisp,  Opus  38.92,  which  uses 
Morgado's  theory  of  Semantic  Networks  as  Abstract  Data  Types  [Morgado86].  When  the 
VMES  project  was  put  together,  this  new  version  of  SNePS,  referred  to  as  SNePS-84,  was 
selected  as  the  base  system. 

When  the  Northeast  Artificial  Intelligence  Consortium  (NAIC)  decided  to  purchase  Texas 
Instruments  Explorers  for  research  and  development,  it  was  clear  that  this  would  be  the  target 
machine  for  our  VMES  project.  One  of  the  main  problems  with  this  was  that  the  dialect  of 
lisp  used  on  these  new  machines  was  Common  Lisp  and  not  Franz  Lisp  as  we  have  been  using 
here  at  SUNY  at  BufiPala  Hence,  the  implementation  of  SNePS79  and  SNePS-84,  both  written  in 
Franz  Lisp,  Opus  38.92,  would  not  run  directly  on  these  Explorers  and  some  conversion  of  code 
would  have  to  take  place  in  order  to  use  SNePS  on  this  project 

Therefore,  the  project  of  converting  the  SNePS-84  S3rstem  over  to  Common  Lisp  and  the 
Usp  machine  environment  was  started.  However,  the  new  system  created  would  not  be  just  a 
direct  translation  of  SNePS-84,  it  would  be  an  enhanced  version  as  well  including  a 
parser/generator  for  lutural  language  and  a  graphical  interface  to  the  network. 

The  Translation 

During  the  past  year,  we  have  translated  all  of  the  code  for  SNePS-84  into  the  Common 
Lisp  syntax.  There  are  several  differences  between  Franz  Lisp  and  Common  Lisp  that  make 
this  a  substantial  task. 

The  easiest  part  of  the  translation  is  identifying  functions  which  have  different  names  in 
Common  Lisp,  and  Franz  Lisp.  Occasionally,  a  function’s  arguments  may  need  to  be  altered  by 
the  addition,  deletion  or  re-arrangement  of  its  parameters.  This  is  usually  due  to  additional 
fiezitnUty  exhibited  by  some  Common  Lisp  functions  to  allow  a  user  to  specify  how  to  mani¬ 
pulate  the  data.  For  example,  the  Common  Lisp  function  sort  allows  the  user  to  specify  a 
predicate  which  will  determine  the  ordering  of  the  elements. 

Another  problem  during  translation  is  when  functions  available  in  one  language  are  not 
available  in  the  other.  When  functions  avalable  in  Common  Lisp  were  not  available  in  Franz 
Lisp,  the  new  must  be  written  to  take  advantage  of  the  efficiency  of  the  new  functions  now 
available.  In  the  worst  case,  it  is  clear  that  new  code  must  be  written. 


^  Morgado,  E  J.  M,  "Semantic  Networks  as  Abstract  Data  Types,"  PhD.  Dissertation,  Department  of  Computer  Sci¬ 
ence,  SUNY  at  Buffalo,  September  1986. 


2A-17 


Foremost  in  the  problem  of  translation,  is  the  rule  of  scope  between  the  two  languages. 
In  Franz  Lisp  scoping  occurs  dynamically.  This  means  that  as  a  series  of  function  calls  are  per¬ 
formed,  calling  environments,  and  related  symbol  bindings,  surround  subsequent  function  calls. 
Therefore,  if  a  symbol  does  not  have  a  value  in  the  immediate  environment,  then  the  surround¬ 
ing  or  calling  environments  are  searched  for  the  symbol.  Lexical  scoping  used  in  Common  Lisp, 
however,  bases  its  search  for  symbol  bindings  ba^  on  the  location  in  the  code  where  that  sym¬ 
bol  is  given  a  value. 

2AA3  Enhancements 

Since  the  project  began,  we  have  attempted  to  get  SNePS-2  working  on  both  TI  Explorers 
and  the  Symbolics  Lisp  Machines  in  order  to  develop  a  system  that  was  easily  portable  to  either 
machine.  Based  on  this  desire,  the  availability  of  personnel,  and  their  experience,  some  enhance¬ 
ments  to  SNePS  have  been  implemented  on  one  brand  of  lisp  machine  before  the  other. 

The  first  enhancement  is  a  graphical  interface  to  the  semantic  network  called  Ginseng. 
This  project  was  developed  on  the  TI  Explorer  due  to  the  availability  of  many  primitive  graph¬ 
ical  functions  found  in  the  TI  Graphics  Toolkit  —  now  included  in  version  3  of  the  Explorer’s 
operating  system.  Such  functions  perform  the  actual  task,  for  example,  of  drawing  a  line,  cir¬ 
cle  or  rectangle  on  the  screen.  Without  these  functions,  it  would  have  been  necessary  to  write 
these  functions  ourselves  to  calculate  the  the  shape  of  the  desired  items  and  draw  them  at  the 
appropriate  screen  locations. 

At  this  point  in  time.  Ginseng  is  capable  of  displaying  any  SNePS  node  defined  in  a  given 
network  using  the  two  functions  gi-desc  and  gi-dump.  Gi-desc  is  essentially  a  graphical  ver¬ 
sion  of  the  SNePSUL  function  describe  which  displays  a  tree  consisting  of  the  current  node  to 
be  described  and  all  nodes  pointed  to  by  descending  relations  from  the  current  node.  Gi-dump, 
which  parallels  the  SNePSUL  funaion  dump,  displays  the  current  node  and  all  nodes  related 
by  either  an  ascending  or  descending  relation.  These  graphs,  once  displayed  on  the  screen  may 
then  be  printed  by  performing  a  screen  dump  to  the  department’s  QMS  laser  printer. 

The  second  enhancement  is  the  Natural  Language  INTerface  (NLINT)  which  consists  of  a 
parser/generator  based  on  an  augmented  transition  network  (ATN)  grammar.  The  purpose  of 
this  is  to  read  in  sentences,  based  on  a  subset  of  English,  and  create  the  appropriate  network  to 
represent  the  inputted  phrase.  With  the  surface,  and  using  the  same  grammar,  one  may  ask 
for  what  a  particular  SNePS  node  represents  in  english  and  it  will  be  displayed  on  the  screen. 

The  NLINT  system  was  initially  translated  from  SNePS79,  and  hence  Franz  Lisp,  onto  the 
TI  Explorers.  At  the  time  of  the  conversion,  no  particular  test  vehicle  (i.en  grammar)  was 
available  to  get  all  of  the  kinks  out  of  the  system.  Subsequently,  this  feature  was  desired  on 
the  Symbolics  machine  and  a  great  deal  of  time  was  taken  to  debug  this  system  on  that  particu¬ 
lar  machine.  As  of  yet  NLINT  has  not  been  brought  back  to  the  Explorer,  but  I  believe  that 
this  transition  will  relatively  effortless  as  the  Explorers  appear  to  be  more  relaxed  in  their 
Common  Lisp  syntax  than  is  Symbolics. 

2A.4.4  Future  Direction 

As  stated,  quite  a  bit  of  SNePS-2  is  already  converted  to  Common  Lisp  and  operational.  In 
fact,  some  additional  packages  to  those  previously  mentioned,  such  as  Multi  (Multi-processing 
simulator)  and  Match  (Network  pattern  matcher),  are  also  working.  The  task  that  lies  before 
us  now  is  to  integrate  this  into  one  large  system,  on  each  machine,  and  debug  the  SNePS  Infer¬ 
ence  Package  (SNIP).  This  is  probably  the  most  involved  part  of  the  conversion  due  to  the  fact 
that  SNIP  uses  all  of  the  other  packages  mentioned  earlier. 

Along  with  the  debugging  of  SNIP  is  the  introduction  of  the  SNePS  Belief  Revisor 
(SNeBR)  into  the  SNePS-2  system.  Due  to  ite  integral  part  in  how  inference  will  be  conducted, 
it  is  not  clear  as  to  whether  the  implementation  of  belief  revision  will  occur  concurrently  with 


or  after  the  completion  of  SNIP.  Perhaps  we  will  defer  work  on  SNeBR  until  after  the  comple¬ 
tion  of  SNIP,  while  keeping  in  mind  the  kind  of  things  that  will  be  necessary  when  we  do 
implement  SNeBR. 
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2A-5  GRAPHICAL  DEEP  KNOWLEDGE:  COGNITIVE  BACKGROUND  AND  PROGRESS 


Recent  progress  in  the  representation  of  spatial  concepts  like  positions,  whole-part  rela¬ 
tions,  and  reference  frames  is  presented.  The  relations  of  graphical  deep  knowledge  to  cognitive 
science  are  shortly  discussed. 

The  concept  and  importance  of  Graphical  Deep  Knowledge  have  been  discussed  in  previ¬ 
ous  publications  related  to  this  project,  e.g.,  Geller,  J.,  Shapiro,  S.  C.,  Graphical  Deep  Knowledge 
for  Intelligent  Machine  Drafting,  Tenth  International  Joint  Conference  on  Artificial  Intelli¬ 
gence  Morgan  Kaufmann  Publishers  Inc.,  Los  Altos,  CA,  August  1987.  In  this  paper  we  will 
review  recent  progress  on  the  subject,  as  well  as  deepen  the  cognitive  background  of  graphical 
deep  knowledge  research.  Much  of  this  material  is  derived  from  Geller,  J.,  A  Knowledge 
Representation  Theory  for  Natural  Language  Graphics  Dept,  of  Gjmputer  Science,  State  Univer¬ 
sity  of  New  York  at  Buffalo,  (dissertation)  1987  (forthcoming) 

2A,5.1  Recent  Progress  in  Graphical  Deep  Knowledge  Research 

!n  Geller,  J.,  Shapiro,  S  C,  Graphical  Deep  Knowledge  for  Intelligent  Machine  Drafting, 
Tenth  International  Joint  Conference  on  Artificial  InteUigence  Morgan  Kaufmann  Publishers 
Incn  Los  Altos,  CA,  August  1987,  pp.  545-551,  a  number  of  different  structures  for  position 
representation  have  been  introduced.  We  have  recently  found  that  all  the  presented  structures, 
and  in  fact  a  few  more,  can  be  summarized  with  one  complex  case-frame.  This  result  does  not 
make  the  individual  structures  unnecessary,  because  access  to  small  simple  structures  is  more 
practical  from  a  pragmatic  point  of  view.  Nevertheless  the  summary  representation  by  a  single 
case-frame  deepens  our  understanding  of  the  concept  of  position.  A  similar  overarching  struc¬ 
ture  will  also  be  shown  for  the  three  different  types  of  part-hierarchies  that  have  been  intro¬ 
duced  in  Geller,  J,  Shapiro,  S.  C,  Graphical  Deep  Knowledge  op.  dt.  Finally  a  case-frame  for 
representing  simple  assumptions  about  the  currently  valid  reference  frame  has  been  found 
necessary  and  will  be  presented.  We  will  start  this  section  with  a  short  reminder  of  the 
representational  formalism  used  to  explain  case-frames. 

2A,S.2  A  Reminder:  The  Representational  Format 

According  to  the  theory  that  is  explained  in  Geller,  Jn  A  Knowledge  Representation 
Theory  for  Natural  Language  Graphics  op.  dt.,  we  view  the  goal  of  our  brand  of  AJ  research  as 
achieving  asymptotic  domain  coverage  for  knowledge  in  a  specific  topic  area.  There  is  a 
number  of  ways  to  specify  such  domain  knowledge  but  in  order  to  do  concrete  work  one  has  to 
make  a  commitment  as  to  which  notational  format  to  use,  and  as  to  what  semantic  theory  to 
subscribe  ta  Our  representational  format  is  based  on  proposition  nodes  that  dominate  sets  of 
arcs.  While  the  proposition  node  is  necessary  to  refer  to  a  specific  proposition,  the  information 
of  the  generic  structure  is  completely  contained  in  the  combination  of  arcs.  One  can  view  this 
combination  of  arcs  as  a  case-frame,  and  this  is  exactly  what  we  will  da  All  structures  shown 
are  given  as  case-frames,  while  concrete  examples  are  given  in  the  linearized  version  of  SNePS 
networks  that  was  for  the  first  time  introduced  in  Geller,  Shapiro,  S  C.,  Graphical  Deep 
Knowledge  op.  dr. 

Concerning  a  semantic  theory  we  wUl  assume  that  the  semantics  of  every  case-frame  is 
dependent  solely  on  the  combination  of  arcs,  and  will  be  specified  by  a  descriptive  semantics 
and  a  procedural  semantics  based  on  an  interpreter  for  the  structures.  The  semantics  for  one 
fram^  cannot  be  derived  by  combination  of  semantic  primitives  that  are  exemplified  by  arcs  in 
the  semantic  network,  but  has  to  be  specified  individually.  Globally  speaking,  the  semantics  of 
a  whole  network  with  many  knowledge  structures  can  be  composed  from  the  semantics  of  the 
single  case-frames. 


2A^3  Position  Representations 


Positions  arc  the  most  complex  phenomenon  in  graphical  deep  knowledge.  Nevertheless  it 
turns  out  that  one  can  get  by  with  a  single  structure  to  represent  every  possible  case.  A 
number  of  special  cases  can  be  derived  from  this  structure  that  make  practical  applications 
easier  to  deal  with.  While  the  special  cases  have  been  discussed  in  previous  reports,  we  will 
now  present  the  syntax  of  the  general  purpose  position  case-frame. 

Syntax: 


object  <object> 
relpos  X  <distance> 

y  <distance-2> 

2  «iistance-3> 

rel-to  <reference-object> 
unittype  <unit-apeci&er> 

space  <space-specifier> 

All  the  terms  written  in  angular  brackets  denote  semantic  network  nodes,  ail  other  terms 
are  semantic  network  arcs  of  the  SI'lePS  system.  From  a  case-frame  point  of  view,  “object” 
represents  a  slot,  while  “<objcct>”  stands  for  a  slot-filler.  The  “relpos”  slot  contains  a  sub- 
frame  which  in  turn  has  three  slots  x,  y,  and  z. 

Procedural  Semantics: 

In  order  to  draw  an  object  <object>,  derive  a  displacement  of  <object>  from  the  object 
< reference-object  >  by  using  <distance>,  <di5tance-2>,  and  <distance-3>  interpreted  as  meas¬ 
ured  in  units  of  the  unit-type  according  to  <unit-specifier>,  and  create  a  pictorial  projection 
according  to  the  <view>  expressed  in  an  appropriate  reference-frame  assertion.  If  a  coordinate 
transformation  is  necessary  to  fit  the  display  on  the  screen,  and  if  <space-specifier>  is  “world”, 
perform  the  transformation.  If  the  specifier  is  “screen”,  do  not  perform  any  transformation 
even  if  that  results  in  failure  of  the  display  request. 

Naturally,  this  procedural  semantics  is  somewhat  “hanging  in  the  air”,  because  no  draw¬ 
ing  will  be  possible  unless  a  form  for  <object>  is  specified  in  the  network.  Objects  might  also 
have  attributes,  parts,  etc.  which  will  influence  the  final  picture.  All  these  representational 
constructs  have  been  sufficiently  covered  in  prior  reports.  The  reference-frame  assertion  men¬ 
tioned  above  is  one  of  the  newer  results  of  this  research  and  will  be  shown  in  a  following  sec¬ 
tion.  Finally,  the  position  of  <  reference-object  >  must  be  available  in  the  network  to  correctly 
anchor  the  relative  position  expressions  in  the  given  case-frame.  We  will  now  give  an  example 
instantiation  of  this  case-frame  as  a  semantic  network  in  a  linear  network  description  format. 

Descriptive  Semantics: 

The  descriptive  semantics  for  the  position  case-frame  will  be  given,  based  on  the  example 
shown  before,  lliis  is  done  simply  because  it  is  easier  to  refer  to  a  concrete  structure  than  to  an 
abstract  case-frame.  The  semantic  network  node  m9  represents  the  proposition  that  pcm-chipl 
is  40  pixels  to  the  right  and  20  pixels  below  the  position  of  trafol  in  the  world.  “World” 
hereby  has  to  be  understood  as  opposed  to  “screen”,  the  example  deals  with  world  coordi¬ 
nates  that  can  be  transformed  to  screen  coordinates  if  necessitated  by  the  given  viewport  on  the 
screen  and  the  actual  values  of  x,  y,  and  z. 

The  backslashes  in  front  of  the  numbers  transform  the  numbers  into  literal  LISP  atoms. 
This  is  necessary,  because  the  numbers  are  treated  as  SNePS  concept  nodes,  which  requires  the 
existence  of  a  property  list  for  them.  Numerical  atoms,  however,  do  not  have  property  lists. 
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Example: 

m9(  object  pcm-chipl 

reipos  m8(  x  /40 

y  /-20 

z  /O 

rcl-to  trafol 
unittype  pixel 

space  world) 

The  sub-case-frame  describing  the  actual  coordinates  is  dominated  by  a  molecular  node  (m8). 
While  the  node  m9  has  to  be  read  as  a  proposition,  m8  is  read  as  a  structured  SNePS  individual. 
m8  and  all  the  structure  below  it  represent  an  individual  corresponding  to  a  point  in  3- 
dimensional  space. 

The  above  case-frame  permits  a  number  of  variations  that  are  not  obvious  from  the  given 
example,  and  that  are  part  of  the  descriptive  semantics.  We  will  discuss  them  arc  by  arc. 

(1)  The  X,  y,  z  slots  can  contain  fuzzy  descriptors  like  “near”  instead  of  numbers.  In  most 
practical  cases  the  2-d  assumption  is  made,  and  the  z  slot  is  completely  omitted.  Under 
the  standard  reference  frame,  x  and  y  are  then  equated  with  screen  coordinate  axes. 
The  displacement  expressed  by  x  and  y  can  also  be  inherited,  in  which  case  the  reipos 
arc  might  be  omitted. 

(2)  It  is  necessary  to  anchor  position  descriptions  somehow,  otherwise  one  gets  an  infinite 
regress  of  spatial  references.  For  that  purpose  the  rel-to  arc  may  point  to  the  special 
concept  “world-center”.  Also  the  rel-to  slot  may  be  completely  omitted  if  the  reference 
object  can  be  derived  from  the  part  hierarchy.  This  is  the  case  if  the  given  object  is  part 
of  another  object. 

(3)  The  most  common  unit-type  of  measurement  is  “pixel”;  however,  the  unit  arc  may  also 
point  either  to  the  reference  object  at  the  end  of  the  rel-to  arc,  or  to  the  object  itself, 
expressing  so  called  body  coordinates  or  reference  object  body  coordinates  which  have 
been  discussed  in  Geller,  J.,  Shapiro,  S.  C.,  Graphical  Deep  Knowledge,  op.  cU. 

(4)  The  space  that  a  relative  position  specification  refers  to  may  be  either  “world”  or 
“screen”.  If  the  space  is  “world”,  a  display  request  will  possibly  result  in  a  different 
screen  position  than  world  position.  If  the  space  is  “screen”,  coordinates  refer  strictly  to 
the  screen  and  may  not  be  transformed. 

2A,5,4  Part  Representations 

As  done  with  positions  before,  one  can  create  an  overarching  structure  to  represent  parts, 
such  that  all  the  part  representations  used  in  previous  publications  will  be  superseded  by  it. 
Nevertheless,  to  mainwin  a  reasonable  efficiency  (in  the  AI  sense  of  the  word),  the  previously 
introduced  special  cases  will  not  be  discarded. 

Procedural  Semantics: 

If  the  slot  of  <real-asBem-clu>  is  taken  by  the  concept  “real-part”,  treat  this  case-frame  as 
a  real -part  assertion.  If  <real-a8sem-clu>  is  “sub-assembly”,  treat  it  as  an  assembly  assertion. 
If  <real-ass-clu  >  is  “sub-cluster”  treat  it  as  a  sub-cluster  proposition. 

In  previous  publications  the  differences  between  these  three  types  of  part  assertions  have 
been  explained.  Real-parts  are  parts  of  an  object  that  has  its  own  drawable  form  such  that  it 
would  be  permissible  to  draw  the  super-part  by  itself,  without  its  parts.  Sub-assemblies  are 
parts  of  an  object  that  has  its  own  drawable  form,  but  drawing  it  without  its  parts  is  not  per¬ 
missible.  Finally,  clusters  are  abstract  objects  that  have  parts  but  no  forms  of  their  own.  If 
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Syntax: 


object 

modality 

part-relation 

sub-object 


<object> 
<modality> 
<real-assem-clu  > 
<object-2> 


necessary,  they  may  be  represented  by  an  empty  box,  for  example. 

In  order  to  draw  an  object  <object>  it  is  necessary  to  retrieve  form,  position  and  possible 
attributes  of  the  object  as  well  as  of  its  desired  parts.  The  part  hierarchy,  in  conjunction  with 
user  requests  for  simplified  displays,  will  decide  which  parts  actually  to  display.  If  a  user 
wants  to  see  a  complete  representation,  all  parts  will  be  shown.  If  he  wants  a  simplified 
representation,  parts  will  not  be  shown,  but  sub-assemblies  will  be  shown.  If  a  complete 
display  of  a  cluster  is  required,  all  the  parts  will  be  shown.  If  a  simplified  diplay  of  a  cluster 
is  required,  the  symbolic  representation  of  the  cluster  as  a  box  wiU  be  drawn,  and  all  the  sub- 
clusters  will  be  omitted. 

Descriptive  Semantics: 

Above  structure  asserts  that  <object-2>  stands  in  the  part-relation  to  <object>  which  is 
specified  by  <real-as8em-clu>.  For  pragmatic  reasons  the  three  case  frames  presented  in  previ¬ 
ous  publications  will  be  maintained. 

2A^,5  Reference  Frame  Representation 

In  the  section  on  position  representations  a  case-frame  concerning  the  current  reference 
frame  was  mentioned.  This  case-frame  will  be  represented  now.  For  NLG  the  problem  of 
reference  frame  identification  represents  itself  in  the  following  manner.  The  screen  that  a  per¬ 
son  looks  at  naturally  induces  a  coordinate  system  with  axes  parallel  to  the  screen  edges.  There 
are  a  few  reasonable  choices  for  the  center  position,  and  we  will  assume  the  convention  of  hav¬ 
ing  a  horizontal  x  axes  intersecting  a  vertical  upward  pointing  y  axes  in  the  lower  left  comer 
of  the  screen.  A  person  may  then  use  screen  coordinates  to  describe  the  location  of  an  object. 
Unfortunately  screen  coordinates  alone  are  an  insufficient  device  for  NLG. 

A  normal  graphics  device  has  a  certain  addressing  range.  Typically  one  has  pixels  from  0 
to  1024  in  the  horizontal  direction,  and  from  0  to  800  in  the  vertical  direction.  If  a  person 
refers  to  a  position  which  is  beyond  this  range,  for  instance  by  using  negative  coordinates,  she 
makes  it  clear  that  she  is  not  interested  in  screen  coordinates,  but  in  world  coordinates.  So  refer¬ 
ence  frame  identification  means  to  determine  the  relation  between  the  world  coordinate  system 
and  the  screen  coordinate  system. 

It  has  been  stressed  before  that  this  work  deals  only  with  2-dimeusional  graphics. 
Nevertheless  it  turns  out  that  people  often  look  at  a  2-dimensional  diagram  with  a  preconcep¬ 
tion  that  this  is  really  a  projection  of  a  3-dimensional  world.  Imagine  a  screen  with  nothing 
but  a  vertical  arrangement  of  two  circles  on  it.  If  one  assumes  that  this  scene  represents  a 
side-view,  then  one  circle  is  clearly  abow  the  other  circle.  But  if  a  person  has  just  looked  at  a 
map,  she  might  be  biased  to  conceive  of  the  diagram  as  a  top-view.  In  this  case  the  second  circle 
is  behind  the  first  circle.  In  the  side-view  an  object  that  is  behind  the  first  circle  would  be 
partly  or  totally  occluded  by  it!  So  a  natural  language  utterance  can  only  be  interpreted  if  one 
starts  with  the  idea  of  a  3-dimensional  world  coordinate  system.  Luckily,  people  don’t  seem  to 
assume  arbitrary  angles  between  world  coordinates  and  screen  coordinates,  so  it  will  be 
sufficient  to  deal  with  a  few  special  cases. 


What  should  be  represented  in  the  knowledge  base  of  the  system  is  the  decison  whether, 
if  3-d  interpretation  is  necessary,  diagrams  should  be  considered  side  views  or  top  views.  .A.lso 
the  terms  “left”  and  “right”  are  hopelessly  ambiguous  as  used  by  people.  We  consider  it  impor¬ 
tant  that  the  system  should  know  explicitly  and  declaratively  whether  it  is  using  these  terms 
based  on  the  user’s  view  or  its  own  view.  This  leads  to  the  following  knowledge  structure. 

Syntax: 

view  <top-or-side> 

Icf  tness  <user-or-system  > 

Procedural  Semantics: 

If  required  to  display  an  object  A  “behind”  an  object  B,  and  the  assumed  view  is  “top” 
then  A  wLLi  be  displayed  vertically  above  B.  If  the  view  specified  is  “side”  then  A  will  be 
displayed  at  the  same  location  as  B,  such  that  B  is  drawn  later  and  overdraws  A.  “In-front”, 
“above”  and  “below”  are  interpreted  analogously.  If  required  to  display  an  object  “at  the  left”, 
and  leftness  is  asserted  as  “user”  (“system”),  then  the  object  will  be  displayed  in  the  left 
(“right”)  area  of  the  screen. 

Example: 

ml(  view  side 

leftness  u.ser) 


Descriptive  Semantics 

The  case-frame  dominated  by  ml  asserts  that  any  picture  that  needs  to  be  interpreted  as  a 
projection  of  a  3-dimensional  scene  is  assumed  to  be  a  projection  orthogonal  to  the  surface 
defined  by  the  screen,  assuming  the  screen  is  in  its  usual  upright  position.  In  addition  it  asserts 
that  any  reference  to  a  lateral  direction  is  assumed  to  be  in  the  coordinate  system  defined  by  the 
body  of  the  user.  Without  such  an  assertion  the  following  questions  would  be  meaningless  to 
the  system:  “Do  you  mean  left  for  me,  or  left  for  you?"  and:  “Is  this  a  top  view  or  a  side 
view?”.  No  other  possible  reference  frames  than  “top”  or  “side”  and  “user”  or  “system”  are  per¬ 
mitted. 

2AJj6  a  Look  at  Cognitive  Science  Contributions  to  GDK 

We  have  recently  extended  our  view  of  graphical  deep  knowledge,  because  it  now  is  an 
integral  part  of  Natural  Language  Graphics  (NLG).  It  turns  out  that  this  permits  us  to  investi¬ 
gate  a  number  of  interesting  relations  between  GDK/NLG  and  cognitive  science.  Interactions 
with  the  three  major  fields  of  cognitive  science,  namely  linguistics,  cognitive  psychology,  and 
philosophy  will  be  discussed.  To  our  own  surprise  we  have  found  that  philosophy  has  contri¬ 
buted  interesting  ideas  to  our  work,  not  only  from  the  theoretical  standpoint,  but  also  from  the 
practical  view  of  user-interface  design.  The  influence  of  linguistics  and  cognitive  psychology 
goes  more  into  the  opposite  direction.  Interesting  questions  and  hypotheses  have  been  raised,  to 
be  answered  by  these  two  disciplines.  Some  pilot  experiments  have  been  performed  to  get 
psychological  results. 

2A,5.7  Yes,  Philosophy  can  be  Useful 

The  philosopher  Paul  Grice  [Grice,  H.  P,  Logic  and  Conversation,  Syntax  and  Semantics: 
Speech  Acts,  3,  P.  Cole  and  J.  L.  Morgan  (eds.).  Academic  Press,  New  York,  1975,  pp  41-59]  has 
introduced  the  so  called  maxims  of  cooperative  communication.  These  are  pragmatic  rules 
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about  how  to  use  natural  language  in  communicating  with  other  people.  They  are  divided  into 
maxims  of  quantity,  maxims  of  quality,  one  maxim  of  relation,  and  maxims  of  manner.  It 
turns  out  that  these  maxims  can  be  applied  to  graphical  communication  with  a  GDK  based  NLG 
S3rstem.  We  will  shortly  point  out  some  maxims  which  can  be  guiding  for  user  interface 
design,  (l)  Make  your  contribution  as  informative  as  required.  We  have  been  able  to  develop 
this  maxim  into  two  sub-maxims  that  apply  to  NLG:  (a)  show  all  possible  views  of  the  same 
phenomenon,  and  (b)  show  a  complete  view  of  one  phenomenon.  (2)  Do  not  make  your  contri¬ 
bution  more  informative  than  is  required.  One  can  interpret  the  use  of  part  hierarchies  for 
selecting  objects  in  simplified  displays  as  a  conclusion  of  this  maxim.  (3)  Do  not  say  that  for 
which  you  lack  adequate  evidence.  This  maxim  can  be  used  in  displays  that  arc  combined  with 
reasoning  systems  that  are  able  to  generate  hypothesis.  A  graphical  display  of  a  hypothesis  has 
to  look  different  from  a  display  of  an  established  fact. 

(4)  Avoid  obscurity  of  expression.  This  maxim  can  be  interpreted  as  a  requirement  to  use 
standard  terminology  whenever  available.  (5)  Avoid  ambiguity.  In  order  to  avoid  ambiguity 
one  has  to  avoid  doubtful  accidental  features  in  graphical  displays,  like  meaningless  intersec¬ 
tions.  Also  the  number  of  icons  used  must  be  sufficient  to  cover  all  the  phenomena  of  the  given 
display  domain.  (6)  Be  orderly.  This  is  of  major  importance.  The  order  of  drawing  different 
parts  in  a  graphics  system  is  generally  considered  unimportant.  All  that  counts  is  the  final 
result.  We  disagree  with  this  notion.  A  good  NLG  system  should  present  the  major  features 
that  a  user  is  most  interested  in  at  the  beginning  of  a  new  screen  creation.  In  a  maintenance 
system  like  VMES,  it  is  important  to  first  display  faulty  components,  and  then  the  rest  of  a 
device.  This  will  permit  a  maintenance  technician  to  react  faster  to  machine  output.  For  a 
deeper  treatment  of  the  subject,  as  well  as  for  a  long  discussion  of  the  maxim  of  relevance  the 
user  is  again  referred  to  Geller,  J,  A  Knowledge  Representation  Theory,  op.  cU. 

2A.5.8  A  Short  Look  at  Linguistics  and  Psychology 

Practical  work  with  the  VMES  user  interface  and  its  natural  language  component  has  led 
to  questions  that  we  have  raised  to  linguists  and  psychologists.  Among  these  questions  were 
the  following.  What  is  the  linguistic  knowledge  about  the  semantics  of  fuzzy  spatial  terms 
like  “left”  and  “right”?  Is  there  any  experimental  work  that  would  help  us  determine  what 
people  think  these  terms  mean?  Are  there  cross  linguistic  studies  on  this  subject?  Most  of  our 
literature  studies  have  resulted  in  negative  answers.  We  have  therefore  conducted  pilot  experi¬ 
ments  concerning  the  meaning  of  the  spatial  terms  left,  right,  top,  bottom,  center,  and  the  four 
comers.  We  have  also  constructed  two  hypotheses  that  limit  the  semantics  of  spatial  terms, 
and  that  are  open  either  to  cross  lingusitic  examination  or  experimental  work.  Details  of  this 
work  can  be  found  in  Geller,  J.,  A  Knowledge  Representation  Theory,  op.  dt. 

2A.5.9  Conclusions 

Three  new  case-frames  have  been  presented  that  concepmally  summarize  a  number  of 
knowledge  structures  of  graphical  deep  knowledge  that  have  been  published  in  previous 
reports.  These  are  a  general-purpose  position  case-frame,  a  new  part  case-frame,  and  a  new 
case-frame  for  reference  frame  representation.  It  also  has  been  pointed  out  that  GDK  has  to  be 
seen  in  the  larger  context  of  Natural  Language  Graphics,  and  that  it  derives  interesting  ideas 
from  pragmatic  rules  of  communication  and  raises  interesting  questions  for  natural  language 
semanticists  and  experimental  psychologists. 
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MMgiiy  BTiig  SUNYMMate  Baffalo 
JuMiOdltr.  WHY  M  Make  Mala 
SaitarfCSrifeaii;  WHY  al  Baf aloe  Baffaia 
SManCShapiiae  StVY al  Bafaloe  Bafale 


K*r  WatBc  Haiawaaca.  Faalt  OucaoB*.  Eapan  Syntm.  Otvkc  Matfcliat.  Dtvic*  Bepnwa- 
tatiaa.  Gfaptacal  KaawMt*.  Gicaii  Board  Aaaljnia  Coer  latcffacc.  Kao«-M|t  »««■<■  Oiaph- 
te  Kaawlad|t  Kepraamtauoa. 


Thia  paper  doBiitaa  a  auialcaaaet  dotta  tkaa  kaa  bata  4(ri(acd 
arith  a  facaa  aa  applied  luwerledfe  wpiaoratotteB  Taro  aaia  poiotcor 
iaictaat  arc  diwrilaJ.  ihc  icpremiatiaa  aad  laeeoniag  aiirliiniirai 
oirraaiy  for  diafooaia  baaed  aa  a  deep  aMdal  of  a  device,  aad  Ibe 
repnaeautiaa  far  aa  iaic|Taiad  iraphical  aacr  laacrfaoc  avlib  liautad 
aataral  laagaey  capobilitiaa.  Deviee  auaeiart  io  rcpecMted  ia  a 
bicrafcby  of  deviee  typea.  StivciamI  Haiplaiaa  aad  iaauatiacioa  nilei 
penait  focaaad  diagaaartc  taaaaaiaf  aaiac  laiy  iaauadaiioa.  Faac- 
liaaal  dea-iipeina  ia  paaeadaially  awarbad  la  the  daelarativt  aetwark 
rcprtacautiaa.  Siailarly.  paaeaa  of  <aBt  ait  anaebad  ta  a 

dcclantivc  reptaaeattte  tf  the  (lapbkal  appaaraaet  af  ibe  device. 

latiadaellaa 

The  VMES  reacarcb  prajKi  ii  aiaMd  at  ibe  dtvelapanat  af  a  ver- 
niile  ataiatcaaaot  capen  ivaeai  far  difhal  dreait  oaubleaboociaf. 
Theoeetieal  aad  practical  aepa  n  tf  faah  diafaaaa,  kaoanad|c  icptcMa- 
uiioa  for  tyma  vetaatilitv.  ead  Laawladirbaaad  gnphieal  repreMU- 
tioa  of  ur|et  devioea  art  btiog  iaveetigaicd. 

VMES  if  dcagned  a<  he  tenecilt  acroB  a  taotc  of  Uitet  devioa  ia 
the  cboaea  doauia  (a  claai  of  dtC»ai  dfcaink  aeroB  aMB  of  the  poad* 
ble  faults  actoB  differtai  maiaieaaaet  kveis  aad  acroB  a  variety  of 
uarr  iaurfaeea  To  achieve  tbeac  leratilitics  tbc  devka  awdel-boied 
approaeb  ia  fallowed.  The  device  atodH-baaad  appnach.  at  oppoatd  to 
the  catpirieal-tulc-baaad  approMb  aaad  by  MYON  (ShortUfcTba)  far 
aMdkal  diagaoda  aad  by  OUB  (HartkyBla]  far  eecapatcr  baidwart 
fault  diagaoda.  ia  auggeiiad  to  have  advaatagea  ia  kaowladgr  aupnei- 
tioa.  diagoedi  capabiUty.  aad  tymm  gcacnlUatmi 
(Oa  viax  OBviaB4a.C«aeBn«tbal 

VMES  it  iapicacatad  ia  SXeFS  {ShapiraTSbl  tba  Scauatic  Net¬ 
work  Fwrearing  Syaacm,  aad  haa'aevnal  BOdalaE  aa  capaadaMc  eoai- 
poaent  Ubniy  ai  ita  kaowledgt  baac  aa  iafercoec  paAage  (part  af 
SNePS)  with  diagaoetic  rales  aa  aetiva  databaae  far  diaga^  a  aacr 
iaurfaor  far  iatcratediau  uacra  (cagiaBia)  to  adapt  VMES  to  acw  dev- 
icea  by  iactencotally  updatiag  the  aoaipoatat  libtary;  tad  a  Bald- 
awdia  mter  iacerfaot  for  rod  aatn  (lechaiciaai)  ta  iateraet  with  VMES 
far  fault  diagaoda.  The  architecturt  of  VMES  ia  abowa  ia  Figure  t. 

Since  a  device  atodel-beted  fault  diagaoda  ayBcat  rcaaooc  directly 
an  tbc  ftructutc  and  funettoa  af  a  device  aad  aaually  aas  a  dnpic 
inference  engine,  Ihc  represenutioa  af  the  deviot  ia  vital  to  t]ntcai  per- 
formaaoe.  We  uie  a  hierarchical  repreacaatioa  af  kaawitdge  to  pro¬ 
vide  abetractioo  levels  cf  devices  Tbit  allowt  a  fault  diagaoda  lyticra 
la  focus  oo  eiiher  individual  objects  or  aa  several  objects  at  a  tim» 

The  knowledge  base  stores  dcKiiptioos  af  all  coniponcnt  types 
used  by  the  urget  devices.  Objects  which  are  pans  af  a  device  arc 
insuatiated  only  when  needed.  A  forauUsni  for  device  representatiao 
udng  insuntiation  rules  and  structural  templates  has  been  dedgned  to 
describe  the  structure,  the  function,  the  intended  auiatenaaec  level,  aad 
the  lest  ifistruction  of  each  component  type  to  tbc  knowledge  base.  Tbc 
basis  of  the  iafercnce  engine  is  SNTP,  the  SNePS  Inference  Package.  It 
also  includes  an  algorithinr  and  diagnostic  rales  for  carrying  out  the 
diagnosis.  The  active  daubase  is  created  for  each  diagnosis  to  store 
instantiated  objecu  and  their  associated  pon  values  and  suics. 

The  r-iulti-medii  user  interface  has  menu,  graphical,  and  limited 


natural  language  capabilitias.  Mob  huasaa  dialogues  about  a  — 
nabject  peobt  froa  the  use  of  diageasaa  ia  odditiea  ta  aataial  ‘-ngr-gr 
rommuairation.  For  circuiti.  teehniriaao  lypknlly  am  wiic  pfara 
whkk  represent  the  fuacdoa  of  a  board,  aad  sarttetanl  di^iaoM  which 
show  the  physical  layout  af  the  eorapoaoBB  af  tbc  dreait.  Tbc  bob 
aatuml  way  for  a  awiaicaaaec  syacas  to  oak  a  aacr  abeat  tbc  voltage 
value  at  a  ipacibc  locstioa  is  to  display  tbc  otstBsarnl  diogtam  of  the 
board  aad  mark  tbc  podtion  whkb  is  cu neatly  nadcr  foetsa  for 
icBaaec  by  higblightiag  h.  While  CAD  syauaB  wM  siailar  latcr- 
fccB  exist,  they  see  typically  baaed  ca  dau  objseB  like  pdatn  Haos.  etc. 
aad  do  aot  omic  kaowledgt  about  vioaal  peopertim  of  the  doradn 
tfkjtat  that  they  am  dealing  with,  fas  oar  opproBh  all  htfoiBacioa 
aaocBary  to  diaplay  aa  object  is  swrsd  m  knonfadge  in  a  ooBinon 
fraawwork  evith  tbc  knowledge  oaccatary  for  doing  diagaosio 

la  this  way  w«  have  coiahiaed  our  wotk  oa  the  giaphkal  inter¬ 
face  with  more  bask  teacarch  ia  the  Mprsacatatioa  of  giaphkal 
knowledge.  Systems  af  kaowladge-bacsd  giaphks  have  boB  rapottad 
in  tbc  liiciature  by  Zydbcl  ct  al  (Zydbcitlal  aad  by  PtiadcU 
(FtiedcUSda]  By  iacotpoeating  more  aad  boss  kaowtsdge  iaio  the 
graphical  interface  arc  have  attained  a  acw  level  of  graphka  that  we 
w-aat  to  refer  to  at  iitttlUgtnt  Mmchbit  Dra/Ung. 

PtTltd  MnddHaf 

Compact  represeautioa  is  dcaiiabic  for  BcaMsy  ooeiwmy.  dtagnos- 
tk  cAcicacy,  aad  system  versatility,  la  dntrviag  that  amay  parm  of 
aa  clectfook  deviee  auy  have  the  mom  compoasat  type  aad  tbns  show 
the  auBc  function,  we  lad  that  teprswariog  every  detail  of  a  device 
will  create  uaaecessary  rsdundaacy.  whkb  kapairs  oysttm  perfer- 
Buaee  and  vciBtility.  lasiead  of  leprearatiag  all  ohJseB  eiplkitly. 
VMES  maiataiae  aa  expandable  ceatpraant  Ubtary.  aad  ObjKm  art 
ioBoatiated  b  aBdod.  Devka  art  amdchd  bkraisbkally.  aod  ohjacto, 
whkb  auy  be  the  devkt  hmlf  or  lit  oab-parti  at  aay  hicraicbied  IcvcL 
are  icptcscated  b  onoibilea  Several  impIcBfatatiOB  have  beta  cxpcii- 
aicnicd  with  (Shapirol6a.Ttkl6al  end  a  foramlBB  whkb  icptotau 
devka  by  inouatiatko  tola  aad  atractatal  lemplaia  k  demribed  bttc. 

Stnictarol  Kaowledec 

The  compoocni  library  coasktt  of  dcacriptkat  of  all  component 
typer  osed  to  coaBruct  the  devka  at  all  bkraicbkal  levels.  Eeeh  coa 
pooent  type  it  in  turn  ebBracted  at  two  Icvck,  oad  tcproeoicd  by  a 
SNcFS  rale  and  a  SNePS  isKrtka.  -The  foraur  k  categotiad  a  an 
*iniunUiiian  rale*,  and  the  Utter  a  *bcractafal  tcmpkte*. 

At  Icvel-I  abetraction.  knowledge  about  a  eompoocot  type  is 
reproented  a  an  insuntiiiioo  rule.  Tbc  nik  is  uied  to  inftintktc  an 
object  of  the  component  type  u  s  moduk  with  I/O  pone  aod  aomcUicd 
functional  docription.  TV  functiooal  deaeriptioa  m  implemented  a  s 
USP  function  that  calcuUia  the  desired  port  value  ta  wnas  of  the 
valua  of  other  porta  this  ellous  the  simuUtiao  of  the  device. 

At  kvcI-2  ebctrection.  a  structural  ttmpUte  is  used  to  describe  the 
sub-parts  and  wire  connections  of  tbc  objea  at  the  next  bkrxrchkal 
kvel.  Component  lypa  tod  intended  maintenance  kvcis  of  sub-perts 
ere  also  indkaicd.  A  structural  tempUte  provida  the  niiiiur) 
knowledge  about  the  sub-structure  of  all  objects  of  the  mme  component 
type  without  icprcscnution  overhexL  Unlike  iosuntiatioo  tulci,  struc- 
lurel  tempUta  ire  never  executed  (fired)  to  produce  a  represenutioa 
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<kc  a^wracauc  af 

Oa  tfct 
tkf  lumHiat 
mfUt  «r  Ike 
I  for  ranker  eiaau- 
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1. 

Atts 


ml  VWCS 
mr*  »ho<»mbituBes. 


(baOdavbSi 

«M  (kaiU  akjKt  >1  ijrpe  K3bl6  abe4v  Utai) 

Tkr  enlxWtw/  fmrt  itatei  ihit  for  tmv)  mkjta  X  If 
kUm/ifftPCMSmiUimhmUtumiUudmiltMl-lhy 

Thifrmfartmf 

imuritMihdU$tlitl/mrtrU0ftkntJm.  Thi 
leeew^  pmrt  mj  wueiiiiBire  mtdgmt  ifce  >«>fir>wrf 
4t»ert/dml0lh»«m^  fortM.  TTit  Kiditf  Km  I* 
iiumm/lmt  4m  la  Bwirerf  eyea.  Bttmmm  tmmbipm 
fOHM  for  HmJmf  emroL 
ef  (taiM  *>  U  l-AifO  -  «TS 

cq  (kaUd  iapan-ar  *1  id  r-AtfU  -  vtS 
Bdmm  tomt  Infoi  fotu  for  rota  dgmoL 
cq  (kaUd  iapoR-gr  *i  id  ii(ia1)  -  vSI 
eq  (kaiid  ai^-aT  *1  id  lifial)  -  vSU 
Jiieerare  eaaw  eaifad  forti  far  odor  dfooL 
cq  (kaild  aaipon-or  *1  id  ai|aBil)  -  vSOt 
cq  (kalid  aatpait-ar  *i  M  elqaaiS)  -  «S02 
Bdamm  tamo  fmertom  mitlfrumrmt  m/mdct  dgoM 
omtfm.  tt  auu*  thm  *0  maladou  tht  fort  mdm  of 
algoioH*tMlliKa  fatcdam  KMidgom  •tkhfma 
argaiaean  (fa  5)  wKIdi  are  <l|<ai  (f ;  *vS/f)  aad 
olhar  four  timlof  dgnata  (i  la  W  aead.  mod 

tha  tdodatad  ratab  aaay  Km  )%  ofarror  teUrmnca 
(talrmeJl 

eq  (kaiid  dkjm  *vSOI  fake  PCMdeitoai  lolrac  S 

pa  S  f1  *vSII  pi  vrs  p3  •vRS  p4  ^>r0  pS  *vRO) 
oq  (kaiid  dbject  *vS06  faae  FOddeitaal  laltac  S 

po  S  pi  •Hl6  pi  VTS  pi  •yfti  p4  vn  pS  VM) 

Figural.  Inatanlialion  Rul«  for  Laval- 1  Abstraction  nrf 
Component  ippe  PCM6l  (FOr  tatting  purpose,  tin  digitBi 
i/o  pemin  ft  pemout  are  oonnaciad  for  eedi  ckennel  to 
form  a  loop  to  that  input  at  tigin  it  eeboed  to  (he 
output  tigouL) 


Ikiai 


dd  b lUaauaiad  ia  F^aeail  «a Iw erhm  I 
SN#S  aadai  arktek  kaiid  SNiK  I 

ef  a  caaipaacai  type  fOdti  aad  F 
aqaivalesM.  Kldk  auadi  for  Ike  til  < 
keaide  wkkh  an  aad  far  i 


rftare  n»  ikrar  acerfaar  a/a  emoMr^  laapdeuc;  Ike /rat 
oaaUamlfattKaaiKaumftmaUfararmnladartjfaaaek 
ai  FCAfd;  Ike  aeeaad  noiaa  denrOad  ike  nAfnta;  and  Ike 
Um  aaatam  amaUtoiu  tha  <atra  aammaalaiu. 

(kaiid 

Saalam  hSlrmaaral  TempUu  tdaaafcMioa. 
typePCM6ata-lv  STTU 

Saalom2:Si*pant  DtscHpOamllocomfUiti  TKaU 

fart  tlaat  tha  aafow  U  of  a  tahpart  adiMa  tha  umfim. 
Tha  aa-mama  part  U  tuad  ta  aaamd  tha  mama  aftha 
mdpart  takao  k  U  buiaailaud.  Tha  typa  part  gK»t 
tha  Ifpa  af  tha  nhpart.  aad  tha  ■uuadv  part  btdieatat 
k$  iMamdad  adraamanea  lataL 
■ikpane 

((kaiid  id  KMk-pcl  en-aaiae  PCI  type  ICC 
nata-lv  oerOD 

(build  id  Kldft-pcl  eat-aanc  Pd  type  PCC 
■Bia-tv  DEPOT) 

(build  id  POdk-ecO  cst-aaae  NOTTC  JO  ippe  VOtO 
auna-lv  OEKD 

(build  id  PCMk-atl  cn-eaaM  .tiOTCjl  tppr  .VOTS 
tuita-lv  DEPOT) 

(build  id  POdk-ialuvaaM  DCI  eppe  XTOlUd 
auiia-lv  DEPOT) 

(build  id  rC3d64sl  en-aaac  L\1  type  XFOKM 
awia-lv  DEPOT)) 

Saalam  S:  WIra Catutaetlemt.(biecmflatai 
feaaeciioaa( 

(build  fieaa  (build  KM  U  ti(ial) 

to  (baud  iapon-af  PQdk^tl  U  la)) 

(build  riaai(buUdoatpeit-er  POdft^sl  id  out) 
to  (kaUd  iapon-of  PC>l6-pel  id  tMe)) 

fCKt  V9  a  a  a 

(build  fraa  (biiUd  iapon-af  POM  id  penia-A) 
to  akuild  iopan^  POdk-pet  id  penda) 

(kaUd  iapon-of  PCUk-pel  id  pcatia) 

(build  iapon-of  POlk-pcS  id  penia))) 

(build  fmai  (build  iapon-of  POdk  id  lO) 
to  (kaUd  iapon-of  PCMk-a«  id  ia)) 

(build  froat  (baUd  outpon-of  POdk-ad)  id  oaO 
to  ((build  iaponof  PCSdk-pcI  id  i-euoke) 

(build  iapon-of  PCMk-pcl  id  t-euobe] 

3l  Smidural  Tempiatat  for  Lovel-2  Abstraction 
for  Component  type  PCM6. 


riMTiiwdl  K—trlstin 

Faaetieaal  kaowlcdfc  of  i  eoapoaeat  lypr  is  repteseetad  as  a 
procedural  stiackattai  to  the  seauaiic  onwocl.  The  foaniaeal  denrip- 
tioa  is  asskle  to  tinulate  the  oompooeai  behavior,  ie,  to  esiealatt  the 


FIgun  4.  Luvai-t  abstrsclion  el  cemponant  type  PCM6. 


2A-31 


«alMi  at  Miff  fom  H  «he  of  ifec  iapn  pom  m  ghaa.  It 
alM  ti  aMklt  M  War  A*  aalaar  af  ikt  iapat  goni  ia  atraa  af 
dwaalaaiaraikvUOpam.  TW  la  laigawat  If  fcypadwifcal  lawaa- 
la  aW  te  faalt  <ligaeili  'Ikaagk  art  kaat  aal?  m$i  tk*  faae- 
tioMi  Wcriptioa  ta  cakiitolt  Ikc  aalac  at  ike  oatgat  pan,  aar 

Ike  faaeiieaal  iiartipiiea  ii  iapleiManil  aa  a  USP  faaetiaa. 
arkkk  calealaf  Ike  Miad  poit  valae  ia  leraM  af  ike  valaci  af  aiker 
poMa  Cany  pait  af  a  aaapaaial  type  kae  eack  a  faactiea  aaociaiaf 
ariik  il.  Ike  Hak  kiiariia  Ike  pan  aad  Ike  faaeiiaa  ia  deaeriked  ia  Ike 
iaaiaaliaiiaa  lak  af  ike  naapnaiat  tyft.  Siaoe  dWereai  paita  af 
dkfeiaal  aaapaaeal  lypea  Wgkt  dap**?  <k*  *■■■*  kekaviar.  aaow  faae- 
tiaaa  caa  kc  Aaiad.  Rgan  «  *awa  Man  caamptca  of  fuactiaatl 
deacriptiaa 


Mc<*  it  Ike  JkHCfiaa  >kr  Ike  oapia  pert  a/  ADD£K-ijpt 

ekjeeu 

(defaa  AOOetout  (iapi  iap2) 

(«  iapI  iap2» 

MawItaaeuMpitlatkawa  jhacriea  jkared  ky  tewtrai 
£LgmwKt  caaifaaiai  lypet  aaaiety  ky  ike  lypr  “fCMf".  ike 
lypa ‘Vdra'* aad lAa ippe 'f ea-f lraat,^aaier**.  AtttkMt 
aenpamaf  lypin  tkanikr  taaw  kekarior  al  aar  ieW  a/ 
caaipaaeat  ainrianiaa;lkeyaefcalkeiapia  lalkeaiapai. 

(diraaBCHO(iapl) 

iapt) 

Man  If  Ike  ykacrfaajkr  Ike  aaipM  port  0/  AS  OCtttHypt 
lOUur  eadlag  It  fotdhU,  ha  jince  ne  ate  //O  ybr 
k^ki/ten,  Ike  JUIentaf  way  ii  a  caanaiumf  one.) 

(defaa  ANOCaat  (iapt  iapi) 

(/  (*  iapi  iapi)  in 


Rgura  &  Examplaa  of  Punciional  Deacription. 


aaad  fni—.!  kaawW|c.  k  aae  diawa  a  arite  plaa.  ii  ia  aoi  aaear 
awy  ta  kaaw  aaaeily  arkeie  la  pat  a  naapnaiat  Cctiaia'  aaaaaetfvhy 
kaaa  la  ke  auMad  ia  aider  la  oaait  a  pictaia  ana  la  Ike 
dhjMi.  aad  acnaki  ccaecarioat  af  ike  diafiiaMali  tiada  kaaa  la  ke 
akwaad.  kat  ikert  arc  aa  a  prtei  lalea  ikai  tpadfy  ikat  a  actaria  laria- 
tar  aaaai  kt  aader  a  acttaia  ckipb  la  fact  not  eaca  acigkkarkaad  rda- 
liana  kaae  la  ke  prmmd. 

*We  arill  Im  diarflii  tkc  npctaralaiioa  aaad  for  ametaial 
itfarripiiaaa.  aad  ikca  talk  akont  logical  di  rriiuiwii  (win  piaae)  All 
Ike  laatkMa  far  auncaical  diWay  kavc  keca  inpleiaentad.  aad  Ike 
inipiennatatica  far  faacifaaal  diaplay  ia  carnally  wall  aa  ita  way. 


It  ia  aaeanary  la  kaaw  akout  tke  form  of  every  abjaet  iaaalvad 
ia  Ike  paadaciiaa  of  a  dnwiag.  ia  oar  ayaica,  feme  an  eiikcr  Bakad 
diiaeily  w  Ike  aemapoadiag  okjca  or  aa  akjan  iakctitt  a  fona  fran  a 
ctaaa  af  akpcn.  Tkii  nqaina  taw  caae  fiance  aae  liakiag  cka  objKC  la 
a  claaa  aad  a  aaeaad  aaa  Hak  tag  the  claaa  w  a  forak  Panaa  npraacai 
Ike  Hak  kiiaaaa  Ike  dacUntivc  aad  ike  paoeaduial  piaae  af  tka 
npnaiataiioa  aynan.  A  fom  ia  at  Ike  aaaae  tiaa  two  diffenat  ikiaga 
it  ia  a  (kan)  aada  ia  Ike  aaaaaaik  actwark.  aad  ia  tkia  way  aeeaadkie 
ky  tke  kaowiadga  km  kaadlar,  kat  it  ia  abo  ike  oane  of  a  USP  fnac> 
liaa  ikat  aoaiaiaa  ealla  la  laaiiaci  of  a  USP  gnpkka  pariragr  SNaPSU. 
eipraaiaaa  far  tom  af  ika  caatf  ranea  dttcrikad  ia  tkia  aad  tka  atai 


POWaar  m  wpimaiad  in  a  variety  of  dif anal  wayi,  Ike  aiaia 
oaaa  kaiag  akaafcilc  nlalivc  pfaitiaai  aad  relative  aak-pan 

Tkc  rmfiarn  far  aa  abjta  arkiek  ia  loeaied  at  aa  akaalalc 
poaitioa  aoataiaa  aa  an  (a  dot)  la  tkc  okjacl.  aad  aicc  10  aodaa  draoriag 
caordiaaie  aaaken.  la  tkc  cm  of  a  niativc  poaitioo  aa  addliioaal  an 
Htntikn  a  ‘nfcreaec  Okjm*.  la  order  aa  dnw  a  rtUtivcIy  plaead 
Object,  tkc  dnwiag  paagnn  kae  10  nuieve  tkc  poaitioa  of  tkc  nfcnaoe 
okjmtnL 

Kdaiively  plaead  aak-parit  da  aot  kave  aa  an  to  a  nfcrcacc 
ob>cc  la  tkbem^  tke  aaaanptioamdcky  tkc  dnwiag  ayncaiiaikat 
tkia  part  aam  kc  plaead  relative  n  ha  *kupeTwkjBCt*.  la  gcactal  tkc 
poaitiaa  of  aay  pan  it  muntd  10  ke  ike  potitiea  of  in  tefcrcaec  poiai. 
By  eaaveatioa  tka  apper  left  aeiacr  b  made  tkc  refarcaoe  poiat  whea- 
cver  penMc.  So  ttc  caaeframa  deaenbad  above  reUtt  to  the  nfcrcacc 
poiaiB  of  Ike  iavalvad  akjnn. 


WhUt  Ike  proem  of  diagaoaii  b  raaaiag.  the  uacr  b  iafomed 
aboal  Ike  oeeivbiea  af  dec  aymn  vb  a  gnphicai  uaee  of  ici  natooiag. 


Tkc  deviee  b  dbplayad  aa  a  gnphin  tcnaiaaL  aad  parte  eamally 
aader  eaniidtntina  an  highlighW  for  ianaare.  by  chaagiag  ikeir 
coloc.  Sam  aeon  decaib  aboat  ihb  will  fdlaw  ia  a  taicr  aaetioa.  ken 
only  npieacBCaiiaaal  gaaatioBa  will  be  nbed. 

la  tkc  ckapicn  above  we  have  iatroduoed  a  occaiioa  for  the 
kaowladgc  aaad  for  diagaoeb.  which  b  kaaed  oa  tkc  SNePS  uaer 
baguage.  All  the  iaformaiioa  aacemry  to  ocaie  a  gnphicai  nprceea- 
utioa  of  Ike  diagnoatb  Object  b  aiorcd  ia  the  very  aamc  kaowbdgc 
fcprcacauiioa  cavinaawac.  Thb  aot  oaly  naini  that  we  an  aaiag  the 
wMw  SNcPSlX  ayaux  lo  dcniibc  Objecta  ia  a  way  that  pactum  na  be 
cieaicd.  but  we  an  uaiag  a  emam  kaowlcdgc  bm.  and  ia  fact  to  a 
oenaia  degree  the  aaiae  ftaoudedge  for  the  dbgaeab  aad  the  drawing 
prognm. 

la  due  repraenutioa  only  prioiiiivc  ahapea  an  atoied  in  a  fom 
oompanbb  id  *claaeieal*  gnphka  pregrama.  For  inaiance.  the  fora  of  a 
multipUer  b  atoted  aa  a  pieoe  of  code  that,  if  executed,  dnwa  a  aiula- 
plbr.  However  any  non  eomplieated  entity  b  atored  deelantively  in 
the  network  lepeeaeautiaox. 

h  b  aeccanry  10  dbtingubh  between  two  dilfercnt  typea  of 
graphical  npreacatatioita  vt'bkh  poae  different  requinmentx.  In  a  attuc- 
tuial  or  pbytkal  icprcaenuiioo  a  device  b  abowo  in  a  geometrically 
analog  way.  If  a  resiaior  b  below  a  chip  on  a  board,  then  one  can 
expect  the  picture  of  a  reaixtor  betow  the  picture  of  a  chip  on  the 
corresponding  plan.  In  order  10  construct  such  a  pixn  a  hunun  aa  well 
as  a  syatcaa  must  have  positional  knowledge.  This  know’ledge  b  usu¬ 
ally  espreoed  by  coordinate  pain. 

Functional  or  loeical  repreienutions.  on  the  other  hand,  do  not 


FIgura  5.  LavaH  abalracllen  o(  component  typo  PCMa. 
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(MM  «bjK(  Oi>Ml 
ram  amk 
■adali^r  faaaioa) 

TkU  J*tcr»€§  m  tbjta  mkk  imJhiUutt  fana 

(baiM  abject  01443 
typt  aMiUplier 
atodabty  faacttoa) 

Thu  MtMtrts  thm  DI-M2  U  a  tmUflUr 

(buiM  cUee  aultipliCT 
Tom  UBiilt 
nadality  raaction) 

ThU  €Jiprtttlen  Uidu  ih*  tUst  iWriffler  M  Ok  farm  xm(i 

(tmUd  object  Dl 

■ub^ra(Ot-MI  0I-M3) 
eub-iTme  (boild  japart-of  OI 

M  iapt) 

•taipoi  (buiM  i  100  jr  300) 
andolity  ruaciioa} 

ThU  if  a  paetiai  UaoifOan  af  Dl.  /(  baf  3  pwtf 
Dt-M!  amd  Dl-Mi.amt  mUmtarmklj  •dueh  U  aa  btfU  fort 
•Uk  Ott  U  iapi  aad  aa  aktaUu  foMm  at  100/300 

KgurmT.  Bcampta  Caapframea  for  Graphical  Knoeutodga. 

Oar  apHca  ate  pe^M  at  to  aaoia  actWhaac  «o abjKM.  Waaic 
dinteiaMiai  bctwaca  tooak  tad  qr«bolie  uifibaiab  ioaak  tttribatM 
aia  dtaaeOy  diapteyabic.  far  iaacam  'bolar*  it  aucb  aa  atiribatt.  Sya- 
baUc  attiftaiti  Malta  a  auppiag  faaelioa  tktt  mOgm  a  dlppityabia 
attribaic  la  a  ayabolk  ttiribaia  Tht  ditfaeat  ptoftaai  — *—  heavy 
aat  oT  tbit  poaibi^.  For  laitiant.  tba  aiatc  (ayatbaUc)  atttibaic  la 
da^yad  by  aappiai  It  to  tbc  coler  (leoak)  amibuic. 

Wa  an  1ricatia(  attribatcc  aa  fuactMaala  that  taka  a  fona  jkae* 
tUm  aad  aa  attributrvalac  aa  atfuaMata  tad  ntan  a  aieditad  font 
raactioa.  TW  nappiaf  betwoca  tyaaboUc  attilbaii  vaiata  tad  hwaic 
attribute  vtlaea  M  thenfon  doat  prooedaially.  For  the  rranipit  above 
tht  attir  *Taalty*  anuM  bt  aup^  to  the  ooler  ‘Yed*.  aad  the  aiatt 
*aaaptct*  aeouM  be  napped  to  *|nea*. 

BcaUta  the  clan  hientchy.  a  port  Mcrarehy  ia  aba  enplejtad 
aaiat  a  caaeftaaM  arith  aa  Objaet  an  aad  oae  or  non  aub^na  am.  It 
ia  peaabk  for  tht  aaer  to  apedry  hoar  aatay  leveb  of  the  part  hienr- 
chy  he  amta  to  an  diaphyod. 

Crarttaritiknil  Iihrawamtidi 

If  oae  trba  to  ante  io|ietl  (fuaetbaal)  npnacautioaa  fron  a 
haowledfe  bate,  thea  tht  folloaruif  iatertatiai  poiati  bwwae  aouWe 

-  Ail  the  poaitioaal  iaforautioo  na  be  elimiaated.  h  ahoaM  aot  be 
Boeetaary  to  aptclfy  toy  bcatioa. 

-  la  oida  to  emit  a  traaoaaMr  picture,  ann  kaoariadtc  of  otlwr 
typet  b  oaoeaniy.  For  ciaoipl^  h  b  oceenary  to  kaoar  arhich 
objeeta  an  iaporta  tod  adibh  objecta  an  outpom  bectan  people 
ofoaliy  eipca  the  aifaal  loa*  oa  a  diafian  n  fo  fron  left  to 
riebt,  or  from  top  to  bonoat.  laridcatally.  thb  iafomatioa  b  abo 
■anrnary  for  diapaoib  aad  therefore  don  aot  ante  aay  addi* 
tioiul  raquinoKata. 

-  Fortn  loon  their  abaoiate  aiitinin|  Objecta  like  arina  aad  botrdt 
raperbUy  doat  aeed  to  be  apecidod  by  frapbia  code,  la  fan  the 
foma  of  all  arim  trill  bt  the  nault  of  a  eoatiaf  alfarithaa.  it  b 
a  arcU  kaowa  dbcriaiiiutiat  factor  betanea  dachntita  aad  pro- 
eedural  nptcaeeutiaoa  that  ,thc  Utter  do  aot  pemit  iaooeipicte 
apeetteatiom  trhUt  the  fonief  oan  do.  Bat  thb  b  exactly  arbat 
oae  wooM  like  to  have.  All  arirea  oooabt  of  vertical  aad  hoftaoa- 
tal  Ibm  but  aothiai  about  the  apedhe  fom  of  a  arin  b  kaotra 
befon  the  poritioaa  of  ^  taipia(ia(  coaopoB**** 

We  abo  have  foaad  that,  ia  teaerat,  for  either  type  of  rtpreteaa- 
tioa: 

-  tht  cUnkal  pan  kkrtrehia  an  aot  auKcicnt  cvea  for  aaoct  ptfaa- 
itive  applicatioiit.  We  have  to  far  dberitaiaated  betanea  real 
parti  end  eub-aaaeaiblici.  ead  oar  man  type  of  wbok-pan  hicrar* 
ehy  for  cluften  might  tiecome  nroesary.  Sub-eiaeotbike  an 


repreatatod  very  ainilarly  n  aub-portx.  oaly  the  on  atthpam  n 
ffplifad  by  tht  an  eub-aaoaa. 


The  Al  UteratBri  hn  n  far  dbraaeed  lahr  rite  ate  ataa^  the  Han 
of  a  clan  hicfaichy.  We  have  foaad  it  afrenery  u  do  btherbann 
abay  oar  part  hienrehy.  aad  to  eoatrol  thb  lahcritaM  with  a 
aeeu-acirbuie.  b  thb  way  a  aaer  caa  autt  daelaratlvcly 
whetha  he  araaei  aa  aciributc  iaheritad  or  aot.  WhUc  ne  do 
araat  to  iaherit  that  a  big  chip  baa  big  porta  twt  do  nor  waat  to 
iaherit  that  if  a  board  b  faulty,  thea  n  an  all  ha  pared 
(Mag  ao  apatial  iaforatatioo  about  the  lorarina  of  objeeta  foron 
at  to  deal  arith  ptadag  aad  routiag  algorithna,  boanva  ear  objecelvn 
an  far  fnn  a  VLSI  deagaer,  aad  non  ootapanble  to  the  TYOES  pm 
jKt  [Fadraldal  b  that  arc  an  Crying  to  ante  a  gnphkally  picaaiag 
npreaeauuea.  We  nfer  to  thb  type  of  draariag  activity  n  /nraOIgmr 
Machdat  Oro/Nng.  a  icna  that  arc  have  not  yci  aeca  ia  Che  Utencarc. 

We  have  dciacd  a  very  limited  cUn  of  circaita  and  an  arorkiag 
oa  autonatb  pUcaag  of  aicmbcn  of  thb  clan  The  clan  hn  baca 
dedaed  fanaally.  but  ia  thb  paper  arc  arill  liaait  ounclvn  to  aa  latiii* 
live  aannary  deacitpcioa.  Dcvica  u  the  clan  cnoiiat  of  0  or  1  naia 
objea  aad  of  porta  of  thb  maia  objecta.  Every  part,  M  anil  n  the 
naia  object,  hat  *porta'.  aad  porta  en  conaectad  by  arirea.  The  aanber 
of  aigaal  patha  aad  the  leagth  of  tignal  pacha  b  expected  to  be  tnall 
raoiigb  M  pemit  placiag  them  arith  cur  rnfuma  vgaaf-apadag  aigm- 
richn  (arhich  arill  be  reviearod  Uteri  All  eonpoocan  have  n  bt  aoa- 
aaeiM  ^Rraighc  forarardly*.  lx.  ao  foedback  lo^  an  pemiciad.  kooc 
(•  parte)  an  all  about  the  taaw  aiic. 

TW  lulana-aqbil'Flnll  algorithm  rlaeeidn  ckanata  aaendiag 
n  their  ligaal  dbraan  fnn  tW  aysun  iaput  pom  aad  aaaigaa  every 
part  n  a  nIanB  h  thea  aguatly  dbtribuica  all  eolaana  ovir  the 
acnea.  aad  ogacUy  dbwAuan  all  parte  iaaide  their  raapeetivt  itilunac 
We  an  carceacly  nvnariag  the  liicntun  oa  \a.SI  routiag.  ia  ordn  to 
decide  apoa  aa  appnprUtt  routiag  algorithm. 

TW  advaatage  of  a  tyncm  that  doex  iu  oura  placiag  baaed  oa 
iafomatioa  about  tW  auuaun  of  iW  devin  b  bbvim  -  to  a  large 
meat,  ontiag  a  kaowledge  boar  for  ataintraanee  purpom  takn  care 
of  cmeiiaa  of  iW  aaoeaaary  graphict.  We  Wve  abo  foaad  kaowledge 
baaed  peegimnniag  to  be  far  ann  robun  thaa  all  other  mnatna  pm 
gfonaaiag  paradigaae.  TW  irarnaiH  eyom  aad  tW  gnphkel  laterfaee 
it  VMES  wen  dnigned  by  differeat  people  wbh  a  aanaai 

of  p— — »*  iatecaeciea.  acverthclen  lystm  lategntioa  did  aot  fan  aay 
dbkuhitx. 


AaotWr  atgaihcaat  advaatage  of  our  reptcacautioa  eynm  for 
gnphioal  kaowledge  b  tW  U-ge  aoMuat  of  SScFS  aatani  laaguagr 
ptoondag  eoftwan  tWt  caa  iaaawdbtely  be  uacd.  W'c  Wve  and  tW 
SNcK  ATN  packate  (Shapirodka]  to  emu  a  aatural  laaguagr  iaterfaer 
to  tW  gnphbe  nutiaxx.  Thb  permiu  at  to  do  Necnnaf  Language 
CrapMcf  (BtowB(la.HuaBaiaBS4a]  almoct  ai  a  byproduct.  tW  oaly  nep 
aaoenary  wn  cW  emtioo  of  aa  ATN  giaaaaaar  for  tW 
gnphbefcinaitbaafd  donaio. 

TW  uacr  na  for  iartana  nqucct  from  the  tyitcn: 

ehow  an  ail  multiplicn 
ahow  nc  DIMI 
ahow  tat  all  faulty  adden 
plaan  dbpUy  Dl 


and  naay  echen.  where  Dl  b  thr  mok  of  a  device,  tad  DIMI  the 
aanc  of  be  tret  multiplier. 


Piatawic  Ktiwhihg 

TW  diagoaeck  rtatoaiag  of  VMES  followt  a  timple  control  xtruc- 
lure.  h  runt  fion  the  top  level  of  the  itrtKtural  hienicby  of  tW  dev- 
bc  aad  trite  «o  had  output  pora  that  vioUu  aa  expeeutioa.  *VioUted 
expecutioa''  b  dcined  aa  a  rabauuh  between  the  expected  (cabaUced) 
value  aad  tW  ebaerved  (oieasarcd)  value  at  tome  output.  Though  tW 
urget  donaia  of  VMES  b  digiul  circuit  boardt.  w«  dbaerved  that  ia 
ml  life  awn  of  tW  clearoaic  boards  ooauia  aarac  aiapir  analog  eon* 
poatau  ruth  n  reanort  aad  tntBfonncn.  Thcrefon.  fa  pnetkal  coo* 
ahlrratinn  aoBK  conpaaeau  en  allowed  to  have  a  totenan  wbea  their 
outpuu  an  being  checked  fa  vMaced  cxpcctatioae.  The  tokrmoa 
inforautioa  b  ataociated  with  the  insuntiation  ru*'  ax  dcpictrd  befon. 

After  vioUied  eepecuiioiu  are  delected,  the  system  uses  the  s;ruc- 
tural  template  la  find  a  subset  of  components  at  the  ikxc  lower 
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hknicMol  iMl  wkidi  «i|bt  kc  f«r  the  kid  MtpMs.  1k«a 

I— ■■iliiliw  mlM  iftiirMid  m  kMaaiiM*  ikt  ■■yim.  and  tkc 

mtiftOB  ut  artmd  ky  mmt  crium  far  fwktt  kiwiftica.  Saipert 
■idwkn  cri«Hia  will  kc  diMHd  iMct.  Ike  diefowk  peecea  k  <kca 
ooatiMMd  M  Ike  MMCiMed  ee^ieiaai  pu«i  A  put  b  daUiad  r<«lty 
if  k  kMwe  toac  vWaied  eipatiika  m.  ke  oMput  poet  aad  h  k  at  iti 
tetcadad  aaiMMaaec  bvel  m  danikad  ia  the  amcaifal  aaaapbtc  ar  it 
k  at  tka  kottoM  Irwal  af  tka  amcMaal  kkiaiaky  aad  ae  fattk'-'  diag- 

A  anall  att  af  S^kK  mica  k  aeiivatad  at  crniy  acage  af  the  diag- 
aaaia  Far  aiaaiplt.  tkiac  raka  aia  aeiivatad  wkea  rcaaiaiag  ateut  a 
paakkia  violaiad  aapartatiaa  af  a  apeeWB  pact  af  a  dcvioc.  Oac  mk  k  to 
dadaee  the  aaaaaaiad  valat  af  the  pact.  A  aaeaaifad  pact  value  caa 
either  kc  dadaaad  faoai  wife  aaaaaeiiaaa  or  lanueiiail  fraai  the  uier.  A 
■aular  rak  k  aekvaiad  far  the  calmlaead  valuta  aad  the  tan  rak  k 
Head  CO  aaaapaia  the  turn  vahiea  ta  decide  if  thcic  k  a  viaiatad  capecta- 
tiaa.  The  hat  mk  k  ahawa  ia  Figuia.  t  ia  kaih  SNcPS  eodc  aad  ia 
Eaglkh. 

Suepacta  am  im  amad  fano  mkiku  bjr  glakal  criteria  called 
fault  po^biUtiaa.  Fault  panikility  k  detcrauaed  by  evaluating  the 
fuapecta  agaian  the  whaikik  euncat  ktuatiaa.  which  k  tkc  curreat 
ten  icaullk  Far  the  curtaai  iaipleanatatiea.  thcic  k  aaly  aae  global 
critcrioa:  a  mipert  baa  higher  fault  paaibiliiy  if  it  coatribuiac  la  aioic 
viaeapet  autpui  porta  Sueperti  withia  each  eablkt  arc  ihca  aorted  by 
laaM  local  critaria  ca^^  faalt  pataatialittaa  Fault  poacaiiality  k  a 
■remfc  af  the  latc  a  particular  type  of  eoaapoacat  auy  faiL  It  k 
iadcpeadcat  af  the  aaviiaaokut.  aaly  drpradiag  aa  the  caatpoacai 
type.  (It  aaay  aha  dcpcad  aa  the  lai  aaaber  af  the  caaipoacat,  but  co 
far  wc  do  aot  treat  each  dciaikj  The  idotl  fault  pateathlity  data  for 
our  daniala  k  lha  theraul  aaalyka  data  af  the  coaipoacoti.  Due  to  the 
aaavaihbility  of  the  thrmal  aaalyik  data.  It  k  aow  laiplcmeated  at 
aa  iodca  raagiag  foeea  t  to  X  Caatpoucat  typa  with  ao  twred  fault 
poieatiality  dau  default  to  X 

X'MES  dace  aot  anke  the  eiagh  fault  aaaampiioa.  The  tyncai 
iacorporaiea  fhe  uaer't  ptdgcaKat  by  ad'etiag  hioi  aa'appoctuaity  to  tar- 
Biiiute  the  diegooek  ackioa  whearver  a  faulty  pan  a  heated.  The 
uicr  caa  choaer  to  coatiauc  the  lavaedgattoa  of  the  icauiaiag  nispectt 
if  he  feeh  that  OMre  fauitt  arc  paaeihh  or  if  he  would  nerety  like  to 
BUkc  curt  other  eutpaett  have  aa  prdhkau 

Crauhical  lufarerace 

At  BMatioaad  ia  aa  earlier  acetMB.  there  k  a  pan  af  the  VMES 
tyncai  that  perauta  the  veer  to  graphicaUy  trace  the  whoh  rcatooiag 
procoa.  Thk  k  doac  by  a  fuactioa  called  dlrplay.  that  Rtriemc 
knowledge  about  how  dbjKti  laok  aad  haw  they  art  loetiad  fren  the 
aetworh.  aad  eoaputet  aad  createt  a  graphical  reprcieatttioa  fiao  thk 
hrkwiedge.  Thk  method  k  aaahgou  to  the  geaetatioa  af  oaturti 
language  fram  a  haawledgc  baae,  a  widely  aoce^  Al  techoique. 

The  tuaoaiag  pan  calk  dkpby  with  the  aaaw  of  the  objKt  that 
thouM  be  dkphyed.  poaubly  with  one  or  awre  of  a  aunber  af  optiaoi. 
We  will  rive  a  gukk  review  af  the  potnbh  optioas  UMCC  deuih  caa  be 
found  in  tShapifoSbil 

It  k  pumiMe  ta  tcicet  haw  ouy  kvclt  in  the  pan  bkrareby 
fhouM  be  dkphyed.  Objccii  can  be  thown  bliaking.  aad  they  can  be 
blowra  up  or  ihronk  to  Cll  the  nrcca  or  a  ptedeCaed  window 
optiiaall.v.  It  k  potnbh  to  create  two  pktutCL  a  deuiled  pktute  af  an 
object  and  a  picture  of  the  *envitontoent*  of  that  abpet.  The  uier  hat 
only  to  tpecify  the  object  iiaelf:  the  cntifvvinMni  k  retrieved  from  the 
pin  hierarchy  by  eearching  upwards. 

A  tuhopiioo  of  the  cnviranmeni  option  peraiiu  the  user  to  limn 
how  may  hveb  up  in  the  pan  bkiaichy  k  varcbed.  The  telcctioa  of 
what  to  show  caa  be  limited  not  only  by  the  number  of  kvclt.  but  alto 
by  the  number  of  parti  or  aoeordii\g  to  an  approaimaic  cognitive  com- 
pktity  w'hkh  w«  are  nmulaiiag  by  oouniiag  the  aumber  of  grapfaks 
primitivet  vkibk  on  the  Kreco. 

Concluiiont 

The  repretenution  tcheme  described  in  this  paper  hat  been  uted  to 
represent  teveral  devieev  including  tevem  moliiplier''addcr  botrdt  and 
a  til -channel  PCM  (Pulte  Code  Modulation)  board  far  tekphone  com¬ 
munication.  VMCS  bat  been  nmesrfut  in  nolating  tbc  fauitt  on  theie 
boards.  A  typical  etample  is  that  VMES  identifies  an  inverter  on  a 
rCM6  board  at  a  faultv  pin.  whith  actually  acccunti  for  the  limul- 
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in  EitfBsh: 

If  the  calcuhlad  and  measured  valuce  of  port  p  are  kmown  m 
vc  A  VB.  out  aad  only  one  of  the  foUowiag  katcmeaia  k  trae 
(1)  wcaad  vea.  agree; 

(1)  poet  p  dkphyt  a  viohtad  capecutioa. 


Figuro  B.  A  dhgnoklic  rwl*. 


taacoiis  malfuaetaauii^t  af  the  two  rbannek  H  affactw  la  the  early  tugc 
of  diagnoka.  Though  VMES  haa  ao  cupabillly  10  ooncliidr  that  It  k  the 
only  fault  aa  the  houid,  the  kiapict  ortetiag  oiterit  help  the  tyaua  to 
dacMc  which  fuapKi  h  in  be  charkad  hm.  The  remit  kmwi  that  the 
lapcamuutiau  rlifmc.  along  wkh  an  aapandabk  compaoeat  library 
leada  tn  mvaeal  tanpoetant  advantagee  onapaet  repremution  aad  aya- 
tem  elbrinifka  ia  both  ayaieai  devtlopaaint  aad  opctaiiag  pbeara 

Wc  fm  claim  that  a  ckar  dktinctioa  between  the  two  ahRmetion 
kvcle  of  aa  abject  k  dcknhk.  The  eepaniiea  bade  ta  eytum  cAckacy 
eiacc  the  kaowkdgt  u  tht  two  ahRiaciioa  Icvck  art  uied  at  different 
augci  of  diagaiuk  Lcvtl-l  laformatioo  k  need  for  detecting  violated 
cspectaiieaA  aad  kvul-1  iafonaatloa  k  uted  for  eutpect  geaetatioa.  To 
nut  them  two  kvtk  together  will  mum  teprematatien  overhead  aad 
hamper  eyetem  pcefocmaaoc. 

The  uac  af  the  pamivc  itrucnual  tempiatew  which  arc  never  exe¬ 
cuted.  la  lepeetcal  the  mhatiwexure  of  Objects  of  a  eoapooeat  type  bat 
advaatagm  aver  a  peoeadufal  lepiematatioa  which  urns  a  ptooedute  or 
aa  iatuatktkB  mk  for  k  [I>avkUa.ShapiiaSfial.  Whenever  it  k 
Bcccakry  to  leaean  aboht  the  mhRmcturc  of  ta  object,  it  k  caniod  out 
Ok  the  uaique  etmctural  template  for  the  oompoaeat  fypr  of  tbc  object. 
Oaly  the  eub-pattt  that  rsquitc  futtber  examinatka  will  he  ianaa- 
tisied  (by  the  proper  hmeatktiea  mke  for  tbcmX  Calikc  the  etrac- 
cuiai  lemplau  leprateauiioa.  a  pcootdutal  rcptcmuiiaa  k  used  10 
iatcaatklc  ^IT  mh-psite  of  aa  ObjKt.  aad  Ihca  the  leamaiag  k  carried 
out  over  the  remitiag  mbMiucrutis.  Thk  leads  to  leriout  tytiem 
incSckacy  due  to  teptemaiacka  expkaioo  aad  rcmuice  waicc  caused 
by  unmeemary  object  iafUaliatioo. 

The  omai  impoetaal  feature  of  VMES  k  ha  vemtility.  VMES  can 
easily  be  adapted  to  new  desrieet  by  merely  eddiag  the  ecructurel  and 
funcilooal  infoematiou  af  tbc  *acw*  coenpoacat  typer  to  the  component 
library.  A  acw  component  type  k  defined  ii  a  oomponent  lypc  which 
has  aot  peevkusly  bM  dckribed  to  the  compooent  library.  The  new 
devioe  iimlf  k  a  new  componcai  type  by  our  definition.  The  effort 
required  to  adapt  tbc  tykem  to  new  devica  should  he  minimal  stnee 
digiul  csienii  devkes  have  a  lol  of  eomoioo  eompooenn.  and  the  tinic- 
tural  and  functional  description  arc  readily  availabk  at  the  time  t  dev¬ 
ice  k  designed. 

We  have  found  at  presentations  that  tbc  graphics  interfeoe  contid- 
enbly  improva  the  un^rstandabiliiy  of  the  reasotung  proocs  of  the 
system.  T^  urn  of  a  know'kdgc  baaed  graphics  system  promises  to  sim¬ 
plify  the  creation  of  graphics  for  new  devices,  io  thk  w-ay  aiding  the 
vcnatiliiy  of  the  system.  The  common  represenution  for  diagnosis, 
graphia  and  a  number  of  natural  language  tools  has  aided  us  io  adding 
a  natural  iaogiuge  oompotKOi  to  the  tyncm.  and  in  this  way 
strengthened  our  belief  in  the  utefuinnt  of  a  knowledge  based  graphics 
system  as  a  oatural  interface  for  a  user  friendly  maintenance  etpert 
tyncm. 

At  a  spin  off,  uy  have  found  limiutioas  in  the  classical  part 
hierarchy  and  inheritance  mechanisms,  and  wc  have  turted  to  work  on 
a  module  for  InttUiftnt  Machine  Orafiinf  as  s  part  of  our  system. 
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abstract 

Model-based  circuit  diagnosis  isolates  the  faulty  com¬ 
ponents  of  a  malfunctioning  electronic  device  by  rea¬ 
soning  on  the  basis  of  structural  and  functional  descrip¬ 
tion  of  the  device.  In  this  paper,  we  argue  that  explicit 
representation  of  wires  and  points  of  contact  (POOONs) 
is  necessary  for  diagnosing  faults  of  ciroult  connections. 
The  traditional  model  of  a  wire  as  a  uni-drectional 
module  is  inappropriate,  becaiise  it  ignores  its  bi- 
daectional  natursr  end  K  does  not  include  POOONs  A 
new  modal  of  wires  and  POOONs  and  the  oorreaponefing 
semantic  network  representation  are  preaanted.  A  wire 
is  modeled  as  a  bi-direetiQnai  module  to  preserve  Ks 
physical  property,  artd  Hs  urti-dkectional  dei^  intention 
is  retained  by  the  ooivtaetion  mechanism.  A  denberate 
component  oocviaction  machartiam  by  eithar  formirtg  a 
POOON  from  two  different  ports  or  superimpoeing  two 
same  ports  together  is  devi^  arte  impiementad.  Exam¬ 
ples  of  usirtg  this  rrxteel  for  drouK  duignosis  are  showrv 
arte  Hs  limitations  are  disoussed. 


U  INTRODUCnON 

A  dedga-exnlel-tNaaii  fault  diagaods  system  itaaoes  oa 
the  taafai  of  stnictntil  aad  functional  deseriptioes  of  a  device. 
The  petfonnaaoe  of  such  s  system,  ia  tenu  of  effective  disg- 
oods  aad  system  (caenUty,  is  depeadeat  largely  oa  the  devte 
oiodeL  The  structure  of  s  device  b  usually  amdeltd  hieieichi- 
cally,  aad  eamponeats  are  modeled  at  modules  with  I/D  ports 
(2,4,8,10).  This  allows  the  sytteiu  to  focus  oa  lelevaat  pens 
ofthedetece.  Wires  aad  wire  connectioos,  which,  according  to 
domaia  experta  are  among  the  major  ctuses  of  devioe  audliiae- 
tion,  have  aot  received  the  denrved  attention  in  previous 
Work. 

A  wire  is  often  modeled  as  a  common  module  with  I/O 
ports,  just  like  other  compoocati  (3,4,101  By  daiaf  this,  a 
wire  b  impUcHly  inmed  to  be  uai-diiectioaal,  siaoe  I/O  pons 
*ie  uai-diiectional  by  oonveatioiL  Thb  reflseti  the  dedgn 
intention  of  the  wire  ia  the  devioe,  but  «""*»««  with  the  phy- 
dcU  reality  of  a  wire  —  although  both  are  important  in  fault 
dugaoda  Though  thb  kind  of  model  b  in  geaenl  good  for 
oompooents  each  as  inveneis  and  IC  diipa  i<*  use  for 
wires  presents  two  proUems.  Fiist,  the  *implicitnesi*  of  the 
tmimption  taelf  b  dangeroui  for  fuUt  diagnods  systems. 

t  ^pib  work  was  supconed  in  pan  by  the  Air  Force  Sys¬ 
tems  Qwimand.  Rome  Air  Devclopomat  Center,  OiHfin  Air 
Wwee  Bam.  New  York  13441-5700,  aad  the  Air  Foroe  Ofioe  of 
^dfic  Remardi,  Botli^  AFB  DC  30333  onder  Contract  Na 
!'3(^3-8^-0008,  which  anpports  the  Northeast  Ai^ficial  In¬ 
telligence  Coamtium  (NA^ 


because  ii  nukes  the  system  iocspible  of  adjusting  themselves 
to  diffetent  diagnostic  situations  (l)  Second,  treating  wirea  as 
uni-diiectional  modules  makes  it  impomible  to  diagaom  some 
wire-fclated  faults,  as  shown  in  the  following  esample. 

A  wire  which  emerges  from  point  A  for  some  length  and 
then  forks  to  poinu  B  and  C  which  is  shown  in  Figure  1,  b 
represented  as 

(rurvwira  (A)  (B))  (run-wire  (a)  (C))  ia  (3L 
where  nia-wite  b  a  function  that  b  used  to  create 
a  wire  from  Hs  first  argument  to  the  second;  or 

(OOMI(A)(Bn  (C0NN{A}(a)ia(4L 
where  OONN  b  a  twnergumeat  ptedkate  ia  some 
kind  of  logb  progiammiag  language,  aad  it  aamrta 
that  there  b  a  connection  from  iu  fiiit  argument 
10  the  moond;  or 

(buHd  from  A  to  (B  C))in(lO], 
where  build  b  a  command  which  builds  a  node 
with  e  ‘Tiom''  ere  poiatiag  to  A  end  two  “toT  area 
poiatiag  to  B  and  C  respectively,  whidi  node 
■amra  that  A  b  connected  to  B  and  C 

Here  A.  B  aad  C  represent  the  three  wire  ends  (wire  porta)  of 
the  wire  the  ectnal  reprematation  of  a  wire  end  in  aonae  sys¬ 
tems  may  be  mare  oompUented  then  what  we  show  here.  All 
theie  repiteeataiions  treat  a  aiiigb  peace  qf  wire  aa  two 
aeparate  wiren  and  show  no  direct  caanectioo  betwetn  point  B 
aad  point  C  Thus  a  short  (bridge)  to  giouad  at  point  C  cannot 
be  noticed  at  point  B,  which  b  guaranteed  to  have  a  value  sup¬ 
plied  at  point  A  in  these  modrln  Thb  may  midcad  a  faidt 
■tbKnafb  syitem  to  ooodude  that  the  oompooeni  wnich  b  ooo- 
nected  to  the  wire  at  point  B  b  faulty,  aiiioe  it  shows  scene  bnd 
output  aad  its  input  (at  point  B)  b  amumed  to  be  intact. 

Another  problem  concerning  wire  coiuiectioaA  whidi  has 
also  been  long  ignored  by  temarcfaeis  ia  fault  diagaoda,  b  tbe 
problem  aaociated  with  tbe  contact  points  ia  aa  electronb  dev¬ 
ice.  Acoarding  to  experts  in  the  dreuit  domain,  a  *Tnd  contact’ . 


ACC 


IDB 

DC 


Piguffli.  A  three-^nd  wire 
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ie,  a  pfoblcm  in  wire  oonnactivity.  it  ■  fuUt  of  elec¬ 
tronic  devioen  A  bad  contact  in  |,  «aua|]y 

oeivad  ai  a  bad  wire  or  a  bad  chip  in  fault  dUfw'M.  gpotemc. 
A  looae  pin  and  Hchct  aaeana  an  iaapropcr  conaactian  between 
a  pin  and  its  boK  aockct.  but  not  a  bad  chip^  which  the  pin 
belongi  ttvor  a  bad  win,  which  the  aockct  belonci  ta  In  thk 
paper  we  aifue  that  “Ipaiat  of  contMt  CPOOOn}".  which  it 
miaeiac  in  the  ezistin|  litoature.  Aonld  be  and  expli¬ 

citly  represented  for  effective  and  oonqdctc  fanli  diapnons. 

la  the  foUowinp  leciioai;  we  diet  review  the  enmiiw« 
model  of  oomponentt  ae  a  awdolc  with  I/O  portn  and  we 
introduce  a  new  model  for  wiiea  and  POOONs  along  with 
some  implementation  detailv  ef  using  this  new 

model  for  oicuit  diagnoah  aie  shown,  and  its  limitations  are 
discuaaed. 


in  connections.  Please  note  that  I/O  ports  are  imaginary  objects 
which  conveniently  represent  the  'places'  where  data  Caignala) 
flow  into  or  out  of  a  component,  and  POOONs  rcpieeent  the 
*relativc  physical  relation*  between  two  other  objects.  This 
itiiid  of  object  is  termed  *paTasitic  object*  since  it  is  not  a  real 
object,  and  its  eristfnnf  always  depoads  on  the  ob jeceCs)  it  is 
aanxiated'  with.  Bgure  3  shows  the  semantic  network, 
representation  for  mese  two  kinds  of  objecu  as  well  as  the 
hieraidiieal  reptesentttion  of  a  device.  Wires,  oomponent  con¬ 
nections,  and  POOONs  are  discuared  in  following  seCTinns.  and 
thus  are  not  included  in  Hgure  3. 


2.  A  MODEL  FOR  COMMON  CXIMPONEKTS 

In  general,  oomponentt  in  a  device  can  be  eategorired  as 
wires  and  non-wires.  We  refer  to  non-wires  la,  the  com¬ 
ponents  other  than  wfies  as  ^common  companenaT,  and  treat 
wires  as  special  componentt. 

Hieiarchicsl  models  of  devices  are  used  to  abRmet  devices 
at  different  levels  of  detaiL  A  «««»—<"»  oomponent  at  any 
abstract  level  is  in  turn  abstracted  at  two  levels.  At  the 
level-1  abstraction,  a  common  component  is  r^tetented  as  a 
module  (a  black  box)  with  I/O  ports  and  asenriernl  fuMtions 
At  the  level-3  abstraction,  subpans  and  wire  of 

the  component  are  envisianed.  Hgnte  2  is  the  pictorial  illus¬ 
tration  of  the  ntodel  for  common  componentt. 

In  our  system,  instead  of  cxplkitly  rquetenting  every 
port  of  a  device  at  all  hierarchical  levels  we  use  an  expandable 
component  library  to  maintain  descriptions  of  component 
*ty^.  and  parts  are  instantiated  dynantkaUy  as  needed.  The 
significant  part  of  this  model  ii  the  clear  diwimtion  between 
level-I  and  level-2  abstraction,  whkh  are  r^etnented  in  our 
system  implemented  in  SNdPS^  the  Semautie  Network  Pnoeat- 
ing  System  (7l  as  an  instantiation  rule  aud  a  aixuctural  tem- 
plats  reqwetively.  Thb  model  along  witk  the  cxpaudable  oom- 
ponent  library  has  advantages  for  system  cfl&dci^  and  veisa- 
tility.  More  details  can  be  found  in  (K^ 

We  investigate  device  "««»»iii»g  from  a  knowledge 
repreaenution  view  and  eonclodc  that  there  are  two  kinds  of 
abject  in  device  representation  by  itt  nature.  The  first  kind  is 
the  object  that  can  be  isolated  from  itt  environment  when  it  is 
being  investigated,  eiamplcs  are  *B1*  in  *the  POdfi  board,  BI. 
if  auspicious*,  *B1-IX3*  in  *tjM  transformer,  Bl-IXL  is  faulty*, 
and  *%1-W12*  in  "the  wire,  B1-WI2,  ia  inttnupced*.  We  call 
this  kind  of  object  i  '^uitd-nlonc  Object*,  which  includes  both 
common  and  special  components.  The  second  kind  of  objects 
are  those  which  are  always  associated  with  aomc  other 
objectCs).  Examples  are  I/O  ports  of  oomponentt  and  POOONs 


Tri- Adder 


Foftetion:  out-inl4in2«in3 
(a) 


FkaireZ.  A  model  lor  common  comoorwnts.  A  iri-adder  is  used 
as  an  exarrole.  Jal  level- 1  abstraciion  <bl  levp|.2  abstraction. 


© 

obiact  type 


B1-IX3  is  a  sUfxl-aione  object 
which  is  repruserded  as  a  b^ 
node  vfth  its  unipMe  nanw 
‘BI-IXTinSNoPS.  Ihtnodsmi 
denoies  that  the  object  81-1X3 
is  ci  type  XFORIf  (trenetoimer). 
(h) 


The  moleciiiar  node  inZ  elands 
lor  the  first  input  port  of 
B1-IX3.  A  port  is  a  parasitic 
object  which  ie  repruMnted  as 
a  stiucturad  object  in  SNePS, 
artd  Is  existanoe  dapands  on 
ks  host  object  Bt-aC3.  Ttm 
node  m3  axpliefliy  assarts  that 
the  object  m2  la  a  PORT. 

(b) 


object 


subparts 


subparts 

liJ  «A_ 

IB1.iX3 


An  axampla  ol  a  hierarchical 
model  of  devioas:  B1-IX3isa 
■ub-paitofBI  (by  nods  mS). 
and  Bi  in  him  ia  a  sub-pan  of 
tie  SVSTBd  (by  node  m4). 


(c) 


FiaifflS.  Qbfefls  and  MBTarehical  modef  of  devices- fal  sland- 
atontt  Obiea:  fbl  parasitic  ohiecl!  tel  hieraichical  rimnnn  mnriid 


3.  A  MODEL  FOR  WIRES 

In  most  previous  work,  a  wire  is  modeled  in  s  manner 
tiinilar  to  other  common  compMvtnts  as  modules  with  WO 
ports.  [2]  or  not  expUcitiy  modeled  at  all  (4,I0l.  We  have 
shown  in  the  introduction  that  this  is  inadequate,  and  here  a 
new  model  for  wires  is  presented.  Wires  are  special  com¬ 
ponents  in  several  aspects;  a  wire  a  merely  a  piece  of  metal  in 
some  fonm  twnted  copper  threads  wrapped  by  plastics  or 
•trips  on  a  printed  circuit  board;  the  sole  functioD  of  wires  is 
to  transmit  signal  (voltage  and/or  current)  from  one  point  to 
another;  and  it  is  maintained  at  all  maintenanoe  levels  —  in 
®®ntrast,  a  couunon  camponent  such  as  a  board  is  usual* 
replaced  only  in  the  field,  and  a  chip  is  replaced  at  a  sh...j 
(depotX 
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In  the  work  ptoeaVed  here,  a  wire  it  tiill  modeled  as  a 
ipodole.  but  the  traditional  unt-directiattal  IA>  ports  an  dis- 
tarded.  Instead,  the  wire  ends  are  r^reaented  as  bi-ports,  a 
new  term  that  stands  for  U-directional  ports,  which  allow  sig- 
nals  to  flow  in  either  dimntion.  The  semantic  network 
jeprEseaution  of  the  wire  model  is  shown  in  Hgure  4  with 
the  ihree-end  wire  in  Figure  1  as  an  wmpi*  The  example 
wire  is  explidtlj  represented  as  a  whole  piece  —  a  module 
with  three  bi-ports.  Now  the  behavior  of  a  wire  can  easily  be 
represented  by  a  rule  asserting  that  all  bi-ports  of  a  wire  have 
the  same  value  (with  ground  dominantX  The  rule  concerning 
Che  behavior  and  diagnosts  of  wires  wiU  be  shown  later.  This 
simple  model  of  a  wire  reflects  its  physical  properties  and 
enaUes  correct  simulation  and  fault  diagnods  of  electronic  cir¬ 
cuits. 


pQUfed.  Amodrifcirwifng.  'ninlhmn.srul  wtrulmm  Rntim 
1  is  used  aa  an  ttcamtilii.  nnd  namnd  BI-WM?,  VWRF.i  |g  Ww 
ComDMiBrthmBtyihranwidwInM  Thnnottea m2.  mS  and mfi 
tenmsem  Ihn  ftren  trim  mds  fl>l-<lrwertnnal  omtsi  m  thn 
ime  Bl  -W12  wllh  Irf-S  as  A.  B  nnd  C  wmneftwtv.  Thn  nndns 
Ma.fnSafxlm7nsseflltMtmg  tn4iindfii«nwoblecfetoiPOBT 

Noe. 


As  mentioned  before,  both  bi-directional  physical  reality 
and  uni-directional  design  intention  of  wires  are  importanc  the 
bi-directional  property  b  useful  in  diagnosing  some  wire 
related  faulty  and  the  uni-directianal  property  b  good  for  fast 
generation  of  suspects  by  tradag  back  the  part  eonnection  from 
bad  outputs.  It  seems  that  our  wire  model  only  preserves  the 
physical  reality,  but  loses  the  desiga  iateation  of  a  wire.  The 
design  intention  ought  to  be  presented  in  soom  way.  A  close 
investigation  reveab  that  our  wire  model  as  module  with  bi¬ 
ports  suflices.  Thb  model  hM  the  bi-directianal  pioperty  via 
the  use  of  bi-ports.  It  also  has  the  uni-directional  property, 
(hough  not  explicitly  reproKated  in  the  ssodel  hself,  via  the 
^OBaections  with  ocher  components  —  a  bi-port  connected  to  an 
oet-pott  serves  as  an  ia-port,  and  a  bi-pott  connected  to  an  in- 
port  serves  as  aa  out-port.  Thb  improves  system  eSciency  by 
aving  the  representtUon  overhead  of  explicitly  icpreaentiag 
the  uni-directional  design  intenttoo  in  the  wire  model  itself. 


4.  CXlNNBCnON  AND  POOON 

The  explicit  represeoution  of  poinu  of  contact  (TOOONs) 
has  not  been  reported  in  the  liteiature.  For  inct«iw»  Oavb  (2] 
deab  with  connections  by  superimponng  the  ports  of  two  con¬ 
nected  components,  say.  a  wire  and  a  chip.  In  thb  caae,  there  b 
no  way  to  find  a  faulty  POOON.  becauae  there  b  no  P(XX>N  at 
alL  In  order  to  catch  thb  kind  of  problem,  POOONt  rbould  be 
modeled  and  explicitly  represented. 

Unlike  componentr  such  as  chips  and  wires,  POCONs  are 
the  'relative  physical  relation'  between  two  ports  of  two  com- 
pooeots,  which  are  'abaolute  physical  entities',  and  thus 
POCONs  cannot  be  modeled  as  physical  componeota.  Neverthe¬ 
less,  since  the  function  of  a  POOON  b  to  transmit  signal 
between  its  two  aides,  it  b  reasonable  to  model  a  POOON  as  a 
logical  compooeot,  and  then  we  can  assert  properties  such  as 
'intact',  'suspicious',  aod  'faulty*  of  it.  Like  a  port,  a  POOON 
b  a  parasitic  object.  A  POOON  b  something  that  can  not  exist 
by  itself,  and  b  always  referred  to  by  the  two  ports  with 
which  it  b  associated.  The  aemantic  network  repreaenuiioa  of 
a  POOON  b  ahowtt  in  Figure  5L 


Superirnposing  bM  same 
po^  ThenodenO 
asserts  thal  the  two  pons 
ml  end  in2  are  tie  same 


poit  abctracted  wtti  two 
oomponentt  et  dWIerent 
levab.  Ml  b  the  first 
signM  bipui  port  o<  board 
B1,  and  mZ  b  the  first  end 
o<  wire  B1-W1,  where 
B1-W1  b  asubpartotBt. 


MaMngaPOCONouol 
two  ddferard  ports. 

UnHta  ni3.  which  asserts 
the  relation  of  two  same 
ports  and  b  not  an  object. 
m6  b  a  CO.  'epiual  object 
o(type:*OCf  which  b 
tormeo  '  j  diNerent 
ports.  m4a>.  mS.  Thb 
makes  k  possdile  lo 
assert  diagnostic  states 
such  as  'suspiciaus*  or 
*taulty*  o(  k. 


FmreS.  PQCX>banrt«viriwrllnnmarhanisn«5 
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Tbcic  «ic  acpiaUy  two  diffemu  oaonectioas  nffnffd  in 
modeling  clectnmie  devkee  in  a  hicnicbkal  way.  One  ia  to 
link  two  porta  which  are  actually  the  aame  port  ataatncted  at 
two  diffeicnt  hierarchical  levela.  An  eumple  ii  that  the  port 
'Ini'*  ia  a  port  of  the  tif-Adder  in  Hgiua  3(aX  and  it  it  alao  a 
port  of  the  ehort  wiic  in  the  left  upper  ooner  of  Rgure  2(bX 
Note  that  the  tii*Adder  and  the  wire  are  at  difercnt  hiecaichi- 
cal  ievetak  hut  they  ahare  the  aame  port.  Thia  port  ia 
repreaeated  aa  two  entitiea:  one  aaaociated  with  the  tri-Adder. 
the  other  with  the  wire.  Thia  prawidca  the 
hierarchical  lewetak  and  thua  nukea  the  traaaitioa  of  diagnoais 
or  device  aiaanlatioo  from  one  level  to  another  poawUe. 

Oe  two  porta  are  actually  the  eanw  oo^  thia  link  h  imple¬ 
mented  by  a  Idiial-oqaiv*  aemantie  netwmk  cmaf ratBt;t  which 
hm  the  aame  effoa  m  Imperimpoaittg*  two  porta  (Sl  0^  thia 
ia  the  only  right  place  for  auperimpoaitioiu  The  other  connec¬ 
tion  ia  to  link  oomponenta  at  the  tame  hierarchical  level 
together.  Inaiead  of  auperimpoaiitg  two  porta,  we  nee  a  “dual- 
contact'  aemantie  network  caaef  tame  to  link  the  two  porta  by 
formi^  the  rqiteaentation  of  a  POCON.  The  uae  of  POOON 
preatrvea  both  the  logical  aenae  of  connection  and  the  phyaical 
aenm  of  contact.  F^re  S  illuatratcc  there  two  >»«««  of  connec- 
tkn  BMdbuiimfa 


S.  FAULT  DIAGNOSIS 

In  thia  aeetion.  we  fim  ahow  how  a  value  and/or  a  atate 
ia  aaeoriamd  with  aa  objea  ia  Figure  6.  Then,  the  methoda  of 
locating  a  faulQr  wire  and  a  bad  POOON  ate  dtrrWird  The 
detaila  of  the  diagnoaia  by  our  eapetimental  ayamm  VMES 
CVenatile  Maintmanor  Expert  Syatem)  are  diaitiwed  in  ($]  and 
(KA  and  thua  only  the  diagnoaia  concerning  vrirea  and  POOONa 
iapreaented  here. 

All  wirea  have  the  aame  function  —  tranamitting  valuet 
^gnal  aa  voltage)  fiom  one  point  to  another.  Though  wirea 
may  have  dUferent  numbera  of  wire  ead^  they  all  dxrw  the 
aame  behavior  —  the  valuer  at  all  enda  of  aa  intaa  wire  are 
equaL  h  ia  naually  nooeapary  to  aimulate  the  behavior  of  a 
componcBt  by  calculating  ita  outputa  from  ita  irtputa 
uaingita  functional  deacription  (3. 4,  LlOl  Unlike  for  common 
component^  there  ia  no  need  to  aimulate  the  behavior  of  a 
wire.  A  aimple  rule  which  amtes  that  a  udie  ia  faulty  if  it 
hm  dUTercat  valuea  at  ita  enda  auficea.  The  role  we  uae  to 
diagnom  wirea  ia  ahowa  ia  Figure  7.tt 

A  POOON  hm  aimilar  fuactioo  to  a  wire  —  it  traaamita  a 
aigaal  from  one  aide  to  the  other.  Remember  that  our  model 
for  POOON  ia  a  logical  Object  which  ia  teptemated  m  a  atruc- 
tured  node  with  two  “Icontact*  area  pointing  to  two  porta  of 


In  SNaPSUL  (SNaPS  User  Langungolt 
ObuBd 

avb  Itpl  >^2  Sw  Sy1  tv2) 

&anft  8buM  object  *p1  bi-port-of  *w) 

(buRd  object  *p2  bHsort-of  *w) 

(buBd  object  •w  type  Wins 
(build  object  ■pi 

•ttr  (buRd  atrb-dx  value  atrb  *v1)) 
(buld  object  V2 

atbr  ftruRd  atrbois  valun  atrb  *v2)} 
oq  (buld  object  *w 

attr  (buRd  atrbds  atate  atrb  faulty 


InBngRahfrtotfcteby  Bnetranatotionlt 

F  pi  and  p2  are  different  bi-ports  of  wire  w,  and 
v1  artd  v2  are  the  values  of  pi  and  p2.  and 
v1  ia  not  equal  to  v2 
THBI  the  wire  w  is  faulty 


FjBWTR?.  Fhde  for  diaonorino  wirestt 


figure  fl.  Semantic  nelwoflt  reofesantation  tor  /al  djaanaslie 
g!1te  aesocialed  with  an  obicct-  and  fbl  vabe  assodaled  with 
AJlfldL 


t  The  “dual-equiv'  aemantie  network  cueframe  a  used  in 
propontional  aemantie  networks  to  link  two  intenskmally  dis- 
tintt  but  extenskmally  equivalent  objeett  together.  See  (51  for 
more  detail. 


****  UVBR  (Unique  Variable  Binding  Rule)  of 
WePS  I9i  differeat  variables  ean  not  bind  to  a  tame  value. 
Tm  hm  the_  advantage  of  better  reasoning  efficiency  ^  mving 
*5**  of  a  role,  and  by  eliminating  redundant  van- 

In  the  role  we  show  here,  there  is  no  need  to  ex- 


Moreover,  there  m  no  antecedent  for  checking  if  vl  and  v2  ate 
equal  ot  not.  because,  under  UVBR,  the  last  two  antecedents 
tte  role  can  be  simuluneously  satisfied  only  if  vl  and  v2  have 
different  values. 
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two  ooApooeBU.  Theidbic,  a  bad  FOOON  can  be  defined  as  a 
pOOON  of  which  (he  two  siaocuting  pons  have  different 
valuer  Mote  also  that  a  POOCW  is  only  a  oonoeptual  object 
which  represents  a  physical  relatioiiship  between  two  ports  of 
t;wo  components.  It  has  no  port  of  its  own.  and  whenever  the 
^ue  of  a  port  of  a  I>OOON  is  requested,  the  port  is  identified 
as  a  port  associated  with  its  host  component  rather  than  the 
POOON.  In  VMES,  we  currently  treat  the  locating  of  a  bad 
POOON  as  a  by-product  of  checking  oomponents.  This  is  done 
by  the  following  method:  whenever  a  port  value  is  acquired. 


(dtagrtosa  B1  PCM6) 

M0OO  tffngnoM  B1:  searchmg  vio-expet . . . 

•>  Tact  Configumtiort  for  PCM6  Bonr^ 

«> - 

0>  1.  conrwet  pemout  to  pemin  for  evory  chnnneL 
2.  syrtchonixa  T-STROBE/SHFT  and  R-STROBE/SHffT 

00099  vkKMtpc  found:  (nn36  nn34) 

(ntSB  (id  (sigoutiB  (Outport-of  (Biffl 
(nn34  (id  (sigoutaj)  (outport-of  (Biffi 

00O0A  suspects  CTMtPCt 

(BI-NOnrOrOBl-NOratOBI-WRI  B1-WR2B1-WRS 
B1-WT1  B1-wr2  B1-WTS  B1-PC1  B1-PC3  BI-KI 
BI-OO  B1-OX1  B1-OX3  B1-W1 1  B1-W12  B1-W13 
B1-W14  B1-W31  B1-W32  B1-W33  B1-W34) 

09999  dingnoso  BI-NOTGrO:  sanrehing  vio-axpet . . . 

whnft  tha  valua  of  port 

(m731  Cd  (outU  (outport-of  (B1-tOTGrO») 

•  (vahiaVnil?  1 

wtiats  tha  vahsa  of  port 

OnBSB  Od  QrO)  Grport-of  (81-NOTGrO))) 

•(vakial/hit?  0 

99999  BI-NOTQrO  shows  no  problam 


99999  dtegnoaa  wira:  Bt-WR1 

whats  tha  valua  of  port 
(m761  (id(2»(biport-of  (B1-WR1)» 
■(valuaM7  0 

whats  (ho  valua  of  port 
(m732  Gd  (3B  (biport-of  (B1-WR1))) 

■  (valual/nil7  1 

99999  wira  B1-WR1  is  faulty 

by  showing  dif  faront  vahlas  at  wira  ands 

Tarmmato  (ho  diagnosis? 

•  y/h?  y 

VMES  manually  tarminatad 

99999  I  GOT  THE  FAULTY  PARTS  AS: 
(BI-WRI) 

Rapair  Ordar  fot  B1-WR1  (typo:WWE3) 
dorra 


Roura  MaL  Locatina  a  bad  wira  on  a  PCM6  btard. 


the  system  finds  soother  port  which  forms  s  POOON  with  the 
first  port,  and  if  the  second  port  has  a  value  which. is  different 
from  the  value  of  the  first  port,  then  the  system  concludm  that 
the  FOOON  is  bad.  This  is  somewhat  siinilsr  to  the  way  a 
human  expert  diagnoses  decoonk  circuits  in  that  he  meawics 
«nwia  port  values  to  check  a  oompooent,  but  the  result  of  the 
measurement  stimulates  him  to  conclude  that  the  fault  is  on  a 
nearby  POOON  tather  than  on  the  oompooent  he  intends  to 
check  [fil 

By  using  the  model  of  wires  and  POOONs  and  the  diag¬ 
nostic  rule  and  method  described  here,  VMES  has  suooemfully 
located  a  broken  (interrupted)  wire  and  a  bad  contact  point  on 
a  malfunctioning  six  channel  pulse  coded  modulation  board  for 
telephone  communication.  Part  of  the  screen  output  for  a  diag- 
nons  Mitinn  is  shown  in  Figure  S. 


•  (dingnoM  Bt  PCM6) 

99999  tffngrxTM  B 1:  SMTCtring  vio-oxpet .. . 


99999  vio-ou(p«  founck  (in36  m34) 

(m36  Od  (sigoutin  (ou(port-of  (BIU) 

(in34  Od  (sigout3B  (outport-of  (B1))) 

60000  suspocts  CTMtodb 

(BI-NOTGrO  B1-NOT(ltO  B1-WR1  B1-WR2  BT-WRS 


99999  dmgrxiM  B1-N0TGr<k  sonrehing  vio-oxpet . . . 


99999  (fiagnoso  wir«  B1-WR1 

whnTs  (tm  valua  of  port 
(m761  Od  (2»  (biport-of  (B1-WR1))) 

•  (valua|/nll7  0 

whatb  (ho  value  of  port 
(m746  Od  (in  (biport-of  (B1-WR1)» 

•[vahieVhB?  0 

wha(^  (he  value  of  port 
(m732  Od  (39  (biport-of  (BI-VfRI))) 

•(valueM?  0 

99999  The  pooon  m733  between  (he  ports 
(m732  Od  (3))  (b%>ort-of  (B1-VfR1)» 

(m731  (id  (outn  (outport-of  (B1-NOTGrO))) 
isfeultyl 

Terminata  (he  dmgnoais? 

•y/h?  y 

VMES  manually  terminated 

99999 1  GOT  THE  FAULTY  PARTS  AS: 

(m733 

(oorttact  (m731  Od  (out))  (outport-of  (B1-NOTGrO))) 
(m732  (id  (3))  (biport-of  (B1-WR1))») 
Repair  Order,  fix  (he  contact  point 
dora 


BawffOtel  Locate  bad  POCOW  on  a  P(X6  board 
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Though  the  rule  ehowa  in  Hguic  7  k  good  for  locating 
interrupted  witc^  it  cannot  haadk  the  bridge  (ihort  circuitj 
pfobiem  of  wiree.  When  a  wire  k  Chdgad  to  ground  or  «"»«» 
other  campancat.  all  wire  eada  eiiU  have  the  aaaw  value  (with 
gtonad  dnminatingX  Thk  ataken  the  bridge  pnMem  dificult 
to  diagnoaei  Nevcrthelcn^  thk  problem  k  not  unaolvable.  A 
bridged  wire  can  be  Mcnrihed  b7  obaerving  a  dUTerenoe 
between  the  aaeaauted  value  at  wire  cade  and  the-auppUed 
value  of  the  wire.  The  eupplied  value  of  the  wire  k  the  value 
which  the  wire  k  intended  to  uaaimit.  The  mpplied  value 
could  be  the  calculated  value  of  an  output  port  of  a  oomponent 
which  k  connerted  to  the  wire,  or  it  could  be  from  a  requeet^ 
teat  in  which  a  value  k  actually  aupptied  to  one  wire  end 
from  outaide  the  board.  Siaoe  wirea  are  eaplidtly  modeled  and 
repreaeatad  in  our  ayaicai.  the  neoeaaarp  ptooedutec  and  uaer 
interactiona  for  cairpiag  out  the  teat  can  caailp  be  imple¬ 
mented.  and  a  bridged  wire  can  be  located  A  harder  problem  k 
bow  to  decide  if  the  bridge  k  on  the  wire  or  on  aome  com¬ 
ponent  which  k  connected  to  the  wire.  One  way  k  to  dkoon- 
aea  the  wire  and  the  component  for  aeparaie  teat.  Though 
thk  caaurea  that  a.bridge  can  be  correctly  located,  thk  opera¬ 
tion  may  be  too  ooetly  and  impractieaL  A  more  reaaooable 
treatment  k  to  aak  the  uaer  to  check  it.  Since  human  beinga 
have  much  better  iriaual  capabilitica  than  computer^  they  can 
detect  moat  bridge  faulta  by  inapection  if  they  arc  directed  to 
the  r^ht  area. 


6.  CONCLUSIONS 

Explicit  repreaentation  of  wirm  and  POOONa  k  necermry 
for  dkgnoaing  faulta  raiding  connectiona.  Our  ayatem,  using 
a  new  model  of  wirea  and  POOONa  as  well  as  a  deliberate 
component  connection  mechankm  of  cither  forming  a  POOON 
from  two  different  porta  or  auperimpoaing  two  aame  porta 
together,  k  effective  in  circuit  simulation  and  fault  dkgnosk. 
Our  system  baa  been  suoccasful  in  locating  intertupted  wires 
and  bad  oontact  pointy  and  it  hm  been  shown  that  it  couid 
handle  bridge  proUema  of  wirea  to  some  extent. 
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Abatnct 

KnowMge4>aeid  expert  eiteimt  art  com- 
puter  program*  for  aequiriHg  and 
manipulating  knowledge  for  tabling  a 
rang*  of  problem*  in  a  giotn  domain. 
Engineering  i*  the  u*e  of  epeeialited 
knowledge  to  eobie  real  woHd  probleme 
Thu*  there  ie  a  doe*  match  between  Aeob- 
Jrtfivtt 

oftJiptrt^fetem*teduu>logyiThi*pap»rit 
an  ooeroiew  of  the  jnethadology  of 
knowledge-baoed  expert  eyeteme  their  im¬ 
plementation,  and  their  potential  a/gdioa- 
tion  in  engineering  Method*  of  knowledge 
repretentation  in  firet  generation  expert 
*y*tem*  and  in  future  generation  expert 
tyeteme  are  looked  at  Some  ongoing 
reteareh  on  expert  tyetem*  methodology  at 
the  State  Uniuereityof  New  York  at  Buf 
fttlo  are  deaeribed 

Thie  work  was  eupported  by  the  Air 
Force  Syetem*  Command,  Rome  Air 
Deuelopment  Center,  Griffi**  Air  Force 
Baa*,  New  York  13441-67000.  and  the  Air 
Force  Offiee  of  Scientific  Reeearch,  Bolling 
AFB,  DC  20332  under  Contract  Na  F 
30602-8S-C-000&  Thi*  contract  eupporis 
the  Northeaet  Artificial  Intelligence  Con- 
eortium. 

L  Introduction 

A  human  axpert  poaseasM  kuowlodgo 
about  a  domain,  has  an  undentanding  cf 
domain  problems  and  has  some  «lritt  at 
solTing  problema  An  expert  sTstem  fiir  a 
given  domain  is  a  computer  program  that 
is  capable  of  solving  p^lems  at  a  perfor¬ 
mance  level  comparable  to  that  of  most 
human  experts  in  that  domain. 


Early  aaooaaass  of  a.^pert  qatems  smre 
in  demains  within  the  (ielda  cf  medicine 
OCVCIN  liisgnosss  bacterial  infectious 
diasasas)  and  ttw  sdences  (DENDRAL 
identifies  chamical  strueturesX  More 
recently  many  applications  have  been 
found  in  tmditinnal  engineering  domaina 
lUa  iaonly  natural  in  Uiat  engineering 
defined  faroetdly,  is  the  uae  of  specialised 
knowledge  to  tolya  real  world  problema 
Examples  of  applications  of  expert 
systems  in  engineering  are:  configuring 
orders  for  computers  (XCON  configures 
VAX  oonvutarapstmas  at  Digital  E«|uip- 
mant,  siinilaily  BEACON  is  used  at  Bur¬ 
roughs  GONAD  at  NCR,  and  DRAGON 
at  ICU,  troobU  shooting  problems  (with 
diaaet  locomotives  telephone  switching 
egujpmsnt,  industrial  Cin  problems  cen¬ 
trifugal  pumps  didi  drives  utility 
transfomima).  preosss  eontrol  (chemical 
plant  control  optimixation),  etc 
The  dtjsetiveoftliis  paper  is  to  outline 
the  msthodnlngy  of  fi^  and  future 
generation  expert  systems  in  the  context 
M  their  appli^ility  to  engineering  and 
to  deaeribe  some  of  the  ongoing  research 
on  expert  syotams  methodology  at  the 
State  University  of  New  'fork  at  BuffiUa 

1,1  Problem  Characteristics 
Tlw  charaotsristics  that  distinguish  an 
expsrt  system  firom  other  computer  pro¬ 
grams  are  fiiat  they  perform  intellectu^ 
demanding  tasks  at  expert  level  perfer- 
that  they  domain 

specific  methods  of  problem  solving  over 
fsnaral  algorithms  of  computer  scienos 
and  that  they  provide  explanations  for 
cooduaions  reached  or  actions  taken. 

Ihe  kinds  of  problems  that  expert 
systenn  solve  may  be  divided  into  those 
ofoMobstr  and  thorn  of  synthesia  Analysis 
problems  involve  starting  with  large 
amounts  of  data  and  arriving  at  conclu- 
sions  in  summary  form.  Examples  of 
analysis  problems  are  interpretation  and 
diagnosia  Interpretation  involves  classi- 
fyi^  or  describing  data;  thus  a  pattern 
nwognition  task  suA  as  determining  crop 
catagoriss  in  a  satellite  photograph  is  an 
expert  interprstatiott  prAlem.  Diagnosis 
is  tbs  ptobim  of  dsteimining  from  a  set 
of  observables  (symptoms  plqrsieal  fin¬ 
dings;  results  of  tastd  the  causes  for  the 
unusual  manifostationa  Diagnosis  in  the 
engineering  domain  is  most  often  a  pro¬ 
blem  of  locdisation  of  faults  using  struc¬ 
tural  and  functional  models  of  the  system. 
Synthesis  problems  involve  beginning 


with  primitive  oompononts  and  arranging 
or  rearrangiag  them  to  satisfy  re- 
quirementa  Examplas  of  problema  of  syn¬ 
thesis  are  configuring  a  computer, 
designing  a  building,  designing  a 
mechanical  or  electrical  component,  etc. 

IX  Role  of  Knowledge 

Expert  problem  solving  seems  to  involve 
search  through  a  judgemental  knowledge 
base  spedalised  to  the  domain. 
knowledge  can  be  either  public  (publish¬ 
ed  definitiona  facta  theories)  or  private 
(not  in  book^  Private  knowledgs  is 
typically  in  the  form  of  rules  of  thumb; 
called  heurietiea  that  are  learned  and 
refined  over  years  of  problem  solving  ex¬ 
perience  in  that  domain.  In  fact,  the  cen¬ 
tral  task  of  building  export  qutems  is  that 
of  elnridating  and  reproducing  private 
knowledga  Knowledge  engineering  is  the 
task  of  extracting  human  expert 
knowledge  and  organising  an  sfih^ve 
repieeentsHon  The  organiari  knowledga 
including  heuristica  general  models  and 
causal  models  of  behavior  is  a  knowledge 
base 

2.  Using  Production  Knles 

The  method  of  knowledge  represent  s- 
tion  should  have  the  following 
characteristics;  gsnsralixstian,  be 

understood  by  peo^  providing  H,  be  easi¬ 
ly  modifiabla  and  be  usafiil  in  a  great 
many  situationa  Knowledge  is 
represented  in  first  generation  expert 
syitems  in  the  form  of  a  sst  cf  inoduction 
rules  The  basic  form  cf  a  production  rule 
is: 

Rule  A,r' 

If  A],  a»  «»• 

Then  6],  b^  ...,  b* 

where  a,-  are  predictates  (statements  that 
can  have  true  or  falm  values)  that  are 
referred  to  as  antreedentr  (also  premises; 
pattema  conditions)  and  6,-  are  referred 
to  as  ooneequcntn  The  consequents  can 
either  be  deduction*  or  action*  A  deduc¬ 
tion  is  inferred  from  facts  about  a  given 
situation.  An  example  of  a  deduction  rule 
is  (If  (UGllT  ON)  Then  (CAN  ^E)). 
Deductions  are  most  common  in 
diagnostic  reasoning.  An  action  rule 
changes  one  situation  to  another,  eg  (If 
(PUMP  PRESSURE)  >  300  Then  (SHUT 
DOWN  PUMP)).  Action  rules  describe  ex¬ 
pert  behavior  in  terms  of  available 
operationa 

A  rule  can  be  viewed  as  a  conditional 


2Ah44 


sUtement,  and  th*  iimacation  of  iuIm  m 
a  aequenoa  of  acttoat  «*««-*<*  hf  modut 
pontnt.  AfloonUactoaodiiapaaon^if  A 
impttca  B  ia  tnia  and  A  ia  traih  than  B  ia 
true  For  enuaipkh  giata  tha  ‘V  X  ia 

human  than  x  ia  Baartal**  and  tha  dKt 
''Soonataa  ia  hamaa.''  Iqr  liiaiaiiHatlin  x 
to  Socrataa  aad  apidylag  awdaa  gonaaa 
««  haaa  Soerataa  ia  aaottaL  Moia  gaaaral- 
ly,  if  A  impliaa  B  aad  B  bapU**  C  than 
A  impliaa  C  —  which  ia  irfarrad  to  aa 
syttogixm. 

W^n  all  of  tha  oj  sra  tcaa  nda  B,  ia 
said  to  ba  triggorad.  A  rola  is  aalactad 

from  tha  sat  of  triggarad  miaa  or  eoa/lM< 

set.  using  a  eonfliet  raaolution  ^txw/iagj. 
Whan  thereoasaqaanta  of  tfw  arioetad  rala 
are  performed,  Um  mla  ia  aaid  to  ba /irsd 
There  are  aeamd  stratagiaa  (br  aalacting 
the  rule  (or  firing  (tom  tha  ooafliet  ast. 
Some  of  thaaa  are: 

1)  Specificity  ordaring  —  arraaga  rules 
whose  conditions  are  a  super-oat  of 
another  rule 

2)  Rule  ordaring  —  arrange  rules  in 
priority  list;  rule  appearing  earliest  has 
highest  priority. 

3)  Data  ordering  —  arrange  data  in 
priority  list;  rule  hanring  highnat  priority 
data  (condition)  has  highest  prMty. 

4)  Siae  ordering  —  rule  haring  longest 
list  of  constraining  oonditioBS  has  highest 
priority. 

5)  Omtaxt  limiting — activate  (or  deac¬ 
tivate)  groups  of  rute  at  aagr  time;  thus 
there  is  leas  likelihood  of  conflict 

The  choice  of  conflict  laaolntion  strategy 
is  ad-hoc  Specificity  ordering  and  context 


limiting  atratagias  are  moaa  oftan  en- 
counterad  than  otham 

The  difEwant  components  of  a  piudne- 
tion  rule  baaed  aapert  ajpatam  are  ahoam 
in  Figure  1.  The  kaoodMifc  6onc  conaiats 
of  the  ast  of  prodnction  rnla%  conted  is  a 
wofhapaoe  fcr  tha  problem  oonatmctad  by 

fttt  infintDCtt  mtduuiim  firvn 
provided  fay  the  user  and  the  knowladga 
beat  and  the  iiqbrmcc  engine  modifias  tha 
context  Apart  ftom  the  main  modnlaa  an 
aspert  system  ahould  also  bo  provided 
with  a  graoafhl  user  interfboe  ancsplana- 
lioa  ^ciiity  and  a  knewltdgx  aeqyMUm 
model. 

2.1  Forward  and  Backward  f*«i"*«.g 

In  the  case  of  synthesis  systems  the 
antecedents  of  the  rules  are  oonditioas 
aad  the  consequents  are  actfamn  Hm  in¬ 
terpretation  or  control  mediaaiam  used  fay 
sjmthesia  systems  is  as  follows; 

1)  Collect  rules  whose  if  parts  are  trig¬ 
gered  and  select  a  rule  using  a  conflict 
reoolution  strategy. 

2)  Do  what  the  rules’  then  part  says 
(fire). 

In  the  case  of  analysis  si^atems  the 
antecedents  of  rules  are  either  observed 
or  derived  facts  and  the  consequents  are 
new  facta  that  are  derivW.  This 
mediaaiam  is  said  to  fix-ward  chain  the 
mien  The  control  mechanism  used  ^ 
analysis  tystema  can  be  either  finward  or 

hnrfamifrfrfMiTwiig  In  Win— rheiwii^ 

a  particular  bypoOiesis  is  selected  ii«««g 

some  diadpline.  The  rules  are 

to  see  if  the  hypoOiesis  ia  a  consequent. 


Ifaq  the  antacodanta  of  auefa  form  tha  nant 
9«t  of  hypotheseSL  The  procedure  is  oon- 
tiausd  some  hypothesis  is  fates  or  all 

hyp  oth  sees  are  tms  baaed  on  the  data. 

Forward  aad  backward  chaining 
ansJyste  tystama  are  analogous  to  bottom- 
up  and  to|>dowa  control  in  fsnaral  com¬ 
puter  alg^thmai  eg,  eompUam  Bottom-' 
up  anatyste  systems  pwgrsmively  rsfins 
t^  data  to  draw  co^uateas.  Tbpdosm 
aaalyste  systems  begin  with  an  expecta¬ 
tion  of  what  the  data  could  dafina  and  sm 
if  dstft  fits 

2.1  Certainty  Compntatioa 

It  is  often  usaffal  or  nsoaasaty  to 
amorists  lemls  of  confidence  with  tulm 
aa  well  as  with  antecedents  and  eonss 
quanta  Thus  the  inAcence  meehsaiam 
needs  a  msthoH  ffai;  say.  computing  t^ 
confidence  of  the  conm^nt  given  the 
confidsnm  valum  of  its  anteesdsnts  aad 
the  eoafidaam  of  the  tula  One  approadi, 
baaed  on  psobabslitiaa  is  as  fbllaws: 

•  Tha  cartainty  of  a  ruWa  overall  input 
tethsprodaet.efthseertainttesasseristed 
with  the  ruUh  aatecadenta 

•  The  certainty  of  a  ruWh  output  is 
given  by  a  single  valued  function  having 
in^  cartainty  on  one  axis  and  output 
certainty  on  aaothar. 

•  Tha  eartadaty  of  a  (act  supported  by 
aevntalmlm  is  determined  by  trandbrss- 
ing  certainties  into  related 

cBlted  lintj  nlio^ 
than  frsnafcrniiiig  the  certainty  ratios 
buck  into  a  eortainty. 

21  Prodawdon 

In  pcind^  aa  aspert  system  can  be 
programmed  ia  any  programming 
language  such  m  FORTRAN,  C,  or  LISP. 
Hosaswr;  as  with  any  complex  sjntem,  (he 
chotee  of  the  tool  can  influence  the 
feasibility  of  constructing  andAor  modify¬ 
ing  it.  Production  rule  ayatsnu  can  be  i- 
ficiently  implemented  using  many 
diflarent  oommaraally  available  tools 
Pomiaent  among  them  are:  EMYCIN, 
KA£i  ROSIE.  (»>S5  aad  PROLOG,  among 
othac  Each  of  them  languageahystems 
provido  a  built-in  inference  mediMiam. 

EMYCIN,  a  system  derived  from 
MYCIN*.  is  particularly  suited  to 
diagnosis  problems;  provides  backward 
chaining  and  allows  certainties  between 
'1  and  -fl  to  be  aasedated  with  data  aad 
conclusions  KAS  hm  derived  fixMn  PRO¬ 
SPECTOR,  an  expert  system  for 
gedogical  exploration.  It  usm  likelihood 
lattes  for  rule  strengths  and  control  can 
be  both  forward  aad  backward.  01^  of¬ 
fers  generality  in  that  it  is  easy  to  tailor 
the  tyteem  to  the  domain  but  unlike 
EMYCIN  and  KAS  it  dom  not  ofier 
sophisticated  front  ends  0PS5  usm  for¬ 
ward  chaining  exclusively.  ROSIE  usm 
English-like  syntax  but  has  no 
ao|foisticated  data  bam  structurs  PRO¬ 
LOG  is  a  logic  programming  language 
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PI 


Pump 


that  pravidaa  aa  infataaca  madianiam 
that  ia  limttad  to  badnraid  chainiap 
Ifaagr  ftadaetiaa  mla  qataaia  a«,  OPSS, 
aia  arrittaa  ia  USP  liat  pmcaaainf 
laaguafa  aagat  oftaa  aaad  ia  aitifidal  ia^ 
tdligaaoa  pngraaaaiia^ 


Advaatagaa  of  a  roMiaaad  ayateai  are: 
thajr  aafcwa  a  hoaiotanaoiia  rapraaanta- 
tioa  of  kaoarladfa  alloar  iacraaieatal 
kaoarladca  gnarth  through  additioa  of 
mlaa  aad  aUiar  uaplaaaad  but  naafiil  in- 
taractioua  —  kaoaHadga  caa  be  applied 
arbeaaeodadaadaetarhaathepiagreai- 
Bier  pradieta  thaai  (by  the  aaaie  tol^  a 
diaadvaataga  ia  that  the  uaar  caa  loae 
ooatroIX 

Seaaral  prahlaaia  of  aaaljraia  aad  aya- 
thaaio  haaa  booa  auooaaiAdljr  haadled  by 
/tratgaairartaa  aipatt  tyUoma  whkh  uae 


ia  teat  of  a  oaoaolittk  aat  of  pradno- 
tioa  lulaa  Aaaaag  thoao  that  ham  baoa 
appliad  fat  oagfaMOfiac  ia  ICON*,  a  aya- 
thaaia  aapart  aiteaat  te  ooafiguriag 


ahotra  the  CtUoftriaf  drawbacka: 


pacta-wUdttothapneaaaofkaoadad^ 
Is  tliM  €0Mmis9  4tf« 

ly  cBinatrirtadl;  aad  tibHQr*liav>  afawat  no 
capabUllsr  of  ajndaai  (onaraUntioii. 


Tho  hayatoua  to  tho  auooaaa  of  oapeit 


tynieollT  luo  aMBEO  awinaa 
doaeripti'aa  liaflnHfaina  of  doaialn  ipedfic 
tenia(a«,  "pauar  plaaC  *>BBpr  ’tteC 
fWaaPBa  AaMQr^QOBBOitDaiTMntaia^ 
itiMiii  o^^oota  Ateip  lalattoBahi^^  to 
eaoh  othar  (a|p,  "PI  ia  a  pump  whoaa 
piaaauro  ia  SW  paDl  aad  orttaria  te  Biak* 
iag  dadaioBo  (ai^  *V  tho  teduatar  puav 
praaaura  aaeoada  400  pal,  thaa  dam  tho 
puaydi  iaput  aalaanL 


ia  a  aiothod  of 
aatiodm(eiidoa) 


ia  tha  aatwork  aad  ralatioaa  aiu 


rapraaaatad  aa  diracted  area  Qabeled  ar- 
nn»a).  A  aoda-aad-Hak  aat  ia  aot 
aaoaaaarily  a  aaaaaatk  aat,  haaaaac  lb  be 
a  aaaiaatk  aatuork  than  iBuat  be  a  any 
of  aaaodatlag  maaaiag  with  tha  aatuocfc. 
Oaa  way  of  dolag  thi%  caUod  praeaiiBra/ 
oaaiaatieaittoaaanriataaaatrfptagtaBia 
that  opwrata  oa  deaeriptioaa  ia  the 
repraaoBtatioa. 


(•) 


Praasure 
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SJI  Pramea 

A  frauM  ptoeidaa  a  abuctumd  ripiaaai^ 
tatioa  of  aa  objoct  or  a  dam  of  oldada  ter 
erampla  oaa  frame  mi^  lapiaoaat  aa 
automobile  aad  aaothar  a  idiola  olam  of 
aatanwbOea  la  a  auae  a  frame  k  a  eot 
lection  of  aninantir  not  aedoa  aad  alola 
that  togothar  doacribe  a  ataaaobfpad  ob¬ 
ject,  act,  or  ooaata  (aoo  Plguro  ^  Coa- 
atnieta  ara  availabk  ia  a  fimao  laagnage 
for  orgaamag  framm  that  rapraaaaft 
claaaao  into  hiaraicUcal  taaoaomka  la 
addition,  apodal  purpooo  doduetioB 
algorithma  oxploit  the  atruetaral 
chaiacteriatica  of  fraataa  to  partem  a  aot 
of  inferoaooa  that  oataada  tho  aapUdtIy 
held  aet  of  belieb  to  a  largaa;  rirtaal  aat 
oTbolkb 

AS  latograted  BanireaaaaBte 

Exampleadfayatema  that  combiaa  tho 
advanta^  of  both  framo  rapraatatalkao 
and  production  ralo  laagnagao  aro 
LOOra  aad  KEB  (Kaoariodgo  Paid*'— r 
ing  Enriroamoat).  Ia  them  qratana 
framm  provida  a  ridi  atruetaral  laaguaga 
tedaar^ngfriaolBartaiateiad  tola  tha 
ruleaFhunotaaoaomkacaaalaobaua- 
od  to  partition  a  ayataubprodnctjoBrulaa 

SNoFS  k  a  aemantic  aotwork  preoam 
ing  ayatem  that  allowa  relational 
knowledge  m  wail  aa  produetloa  mka  to 
be  lepreaented  in  the  form  of  a  aamaatic 


network.  SNePS  ia  particalariy  ap¬ 
propriate  when  aatoial  language  inter 
bom  are  iaiportaat 
Future  generation  expert  oyatema  will 
rely  on  a  problem  mlviag  architecture 
au^  m  the  blackboard  wfaidi  k  a  t 

fretaawork  that  allowe  aeveral  knowlodfa 
aourem  (or  expert  oyatema)  to  intoract  ia 
Um  adution  of  a  problem.  Aa  enviroument 
for  ouch  an  approach  ia  GBB  (Generic 
Blackboard  D^lopment  ayatem). 


4.  It— i>inT*i  at  SUNY  ai  Balblo 

RaMveh  k  aagoiag  in  the  OapartniMit 
flf  Oflaapirtar  ^Wtwf  ■*  fiiTW  atBulIalo 
on  methodalociaa  fir  ag^art  qntena  that 
aoivB  aa«ij«ia  problma  la  particular  we 
are  aaploruif  the  ilaaign  it  kaoarladpa- 
baaad  mp/tmat  far  image  iatarptatatioa 
(raragniaiag  eHjacta  in  complex  ea- 

mmA  Cm-  II.  tK»  im- 

aga  iatarpratatiOB  area  oar  work  ooucaini 
hoar  toceorfiBato  a  community  of  experta 
in  achieving  a  oommou  goal*^  and  hw  to 
daaaiop  export  aykema  for  utilizing 
qwtiel  kaoirlodta  in  image  intarpretation 
proUema*.  Our  bnaga  interpretation 
methoda  amphaaixe  the  uae  of  a 
blackboard  arrhitertufe^  framea,  and  pro- 
ductioB  qntanm  In  the  diagnoaia  area  our 
work  eantaia  on  how  to  lapraaent  apatial 
and  other  model  knowledge  in 
diagnoaiB^***.  In  the  remainder  of  this 
eectioa  «a  focoa  only  on  our  reaearch  in 
the  area  of  diagnoatie  expert  ayatem  since 
it  is  a  commcsdy  sntmintereii  enginewing 
problam. 

In  the  «tiagnoatif  igpUeatum  of  expert 
ayataam  fiiat  gasMBOtian  ayatssna  can  also 
ba  rsfonad  to  as  ayavkaedossit  ainoe  the 
miss  eooaiat  of  mapping  symptoms  to  in- 
termadiata  or  final  co^uskma  Expert 
ayatamabaaadoBdirsetaiappiBgofobaer 
vationa  to  eoadnahm  are  a^  to  have  on¬ 
ly  tkaUau  knowlad^  Second  and  future 
gansratioiidiagnnatiraapaitayatemsthat 
utilim  a  aaodal  of  the  plqaieial  system  as 
an  emintial  partrf raaanning  may  be  said 
to  paafora  OB  Um  boaio  of  dev  haswledge 
An  important  component  of  deep 
knowla^  ronsjsts  of  design  specifica¬ 
tions  of  the  dsvioo  and  bonce  the  resulting 
systems  nmy  be*  said  to  be 

Thme  are  aoe^  ways  of  modeling  a 
^qrafcal  aystoaa.t1w  analytKal  capabili¬ 
ty,  flexibility  and  afficienqr  of  the  reason¬ 
ing  procam  can  be  expected  to  depend  on 
the  model  aelactad.  IW  ongoing  cfibrts  on 
modeling  and  rsprsaentatinn  for  diagnoeis 
are  dea^had  in  the  following. 

4.1  Behnvioral  and  StmctursJ  Models 

A  physical  system  can  be  modeled 
behaviorally  and/or  structurally.  A 
behavioral  naidel  is  a  logical  model  and 
a  structural  model  is  a  phytieal  model. 
The  method  of  modeling  may  be  difierent 
at  difforent  levels  of  abstraction,  depen¬ 
ding  on  the  task.  Ihe  logical  model  is  a 
funetsonally  (causally)  oriented  abstrac¬ 
tion  where  each  logical  component  has  a 
localised  contrfoutioa  to  ove^l  behavior. 
A  physical  model  is  a  representation 
whm  each  component  is  described  in 
terms  of  its  pfayaieal  diaracteriatiea  In  the 
rmnms  of  niodeling  functional  (or  logical) 
structure  may  be  derived  from  an  obser¬ 
vation  of  the  physical  structure  in  a 
bottom-up  manner.  Two  models  of  the 
same  type  have  a  hierarchical  relation  if 


one  is  an  sbatraction  of  the  other  The 
logical  and  pfayaieal  models  of  a  physical 
syatam  often  eowvapend.  For  inatancB  the 
power  train  of  an  automobile  eonaista  of 
tvm  functional  (iagieal)  cnmpooenta  tha 
engine  vdiidi  providm  power  and  the 
transmiwion  which  eopverts  power  to  mo¬ 
tion.  Thaas^  in  turn.  correspoBd  to  the  two 
ifoyaieal  ooBgionsBtB  tha  engine  aaaaaebly 
*“**  **»*  *T~rviir*****~  — tf f* ' ' 
the  two  ^rpm  of  modds  somatima  in¬ 
tersect.  A  digital  dieuit  is  functionally 
modeled  fay  a  logic  diagram  in  which 
logical  components  such  sis  “and  gatas" 
or  “or  gates”  oontribote  locally  to  the 
whole  cireuit,  but  aavsral  fimirtionally 
unrriated  logi^  oompoBSBts  may  faw  oon- 
tained  in  the  same  pfayaieal  oomponant, 
oix.  an  integrated  dimiit  chip.  Our  affort 
is  to  develop  a  theory  of  multi-laval  device 
repieaentatioB  witl^  which  atruetnral, 

ftnwittMial  mm  —II  mm 

knowledge  can  be  repreaantad. 

4JI  Veisatfla  tfalntaanapa 

A  theory  and  an  implements ticn  of  a 
device  lepreaeutstioB  adiaBaa  far  versatile 
maintenance  of  digital  dreuita  is  baing 
devdopad.  \fanatilifay  of  diagneak  k  defin¬ 
ed  multidimansionally  acnaa  a  langs  of 
targat  daviosA  knltA  maintananea  kedp 
and  user  ii^atfboaB  Cantral  to  design 
model-baaad  fonh  ifiagimak  k  a  device 
rvraaantation  adtama  with  tha  feDowing 
attribtttac  eiiirmaive  powas,  ease 

KiiiMing  ilif 

gcfiOTidiziAioii  ibOilQr  ab4  npMdOrflityp 
and  ability  to  oparato  oa  the  rspraoanta- 
Upn.  De^^  stnictuie  k  rapreaanteil 
hierarchicaUy  to  rofloct  the  dssigB  aoodel 
of  most  deviM  in  tha  domain.  Eadi  ob¬ 
ject  of  the  devka  hiarardqr  has  the  farm 
of  a  moduk.  Instead  of  rapresantiBg  all  ob¬ 
jects  explicitly,  an  expandable  oomponant 
library  k  maintainad,  and  ofajaeta  are  in¬ 
stantiated  only  when  nsaded.  The  oompo- 
nent  library  consists  of  daaeriptions  of 
component  (ypcs  used  to  oOBSti  net  dsvicm 
at  all  hierarchical  kvek  Each  component 
is  repreoented  SB  an  instontktioa  r^  and 
a  structural  template.  Hie  instantiation 
rule  is  used  to  instantkto  an  object  of  the 
component  type  as  a  module  with  I/O 
ports  snd  associated  functional  daacrip- 
tiona  Structural  templatee  deacribe  sub¬ 
parts  and  wire  eonnectkns  at  the  next 
lower  hierarchical  level  of  the  component 
type  The  implementation  of  VMES  (Vn^ 
satile  Maintenance  Expert  fiystem)  k  be¬ 
ing  done  using  SNePS 

5.  Summary 

There  exists  a  eloee  match  between  the 
capabilities  of  expert  syxtems  and  the 
ne^  of  engineering  practice  Knowledge 
acquisition  attd  rsprosentatioa  k  central 
to  the  design  of  expert  syoteme  Produc¬ 
tion  rules  are  the  prafenad  method  for 
representing  knowledge  in  first  genera¬ 


tion  expert  systems  Second  and  future 
generation  expert  ayotems  will  integrate 
production  rulm  with  aemnntic  networke 
frames  and  other  knowledge  lapmaaato- 
tioB  aehemee  Our  research  on  expert 
systems  methodology  at  SUNY  atButhlo 
k  currently  focused  on  probkms  of 
analysk  such  aa  imago  intarpiatatioa  and 
fault  diagnoak  In  tbo  diagnoaia  area  the 
efforts  are  to  develop  a  theory  of  multi¬ 
level  device  knowledge  lapiaoontatioB  and 
an  approach  to  versatik  maintenanoa  bas¬ 
ed  on  a  aomantie  network  rapsusantatiow, 
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Device  Representation  and  Graphics  Interfaces  of  VMES 
J.  Gcllcr,  M.R.  Taic,  S.C.  Shapiro,  S.N.  Srihari 
Department  of  Computer  Science,  State  University  of  New  York  at  Buffalo, 
Buffalo,  NY  14260,  U.S.A. 

ABSTRACT 

The  VMFLS  pro.ieci  aims  to  create  a  device-model -based  versatile  maintenance 
expert  system  which  assists  the  user  in  isolating  specific  faulty  components  or 
connections  in  a  malfunctioning  digital  circuit.  We  describe  a  device  represenu- 
tion  formalism  that  supports  the  diagnostic  reasoning  of  VMliS  and  eases  its 
adaptation  to  new  devices.  The  salient  feature  of  this  scheme  is  the  inclusion  of 
both  logical  and  physical  structural  descriptions  of  the  target  device.  T'he  two 
representations  enable  VMES  to  make  efficient  diagnostic  judgements  and  to 
interact  effectively  with  the  user  in  performing  repair  and  test.  The  user  inter¬ 
face  of  VMI'^  Is  treated  as  a  separate  area  of  scientific  investigation.  We  describe 
the  design  and  implementation  of  three  interfaces,  vU^  a  graphics  display  inter¬ 
face,  a  graphics  input  interface,  and  a  natural  language  input  interface.  The  use 
of  knowledge  based  interface  technology  has  proven  a  rewarding  area  of  resrareh 
from  the  theoretical  as  well  as  the  applied  perspective. 

INTRODUCTION 

VMES  is  a  device-model-based  versatile  maintenance  expert  .system  for  the 
domain  of  digital  circuits  [7j.  The  objective  of  VMES  is  to  interact  with  a 
maintenance  technician  (the  user)  to  identify  the  specific  faulty  component  or 
connection  of  a  malfunaioning  circuic  The  versatility  of  VMES  is  multifold: 
across  a  wide  range  of  devices,  covering  most  possible  faults,  suiuble  foi  different 
maintenance  levels,  and  providing  am  intelligent  user  interface.  VMES  uses  a 
device-model-based  approach  since  it  is  more  general  than  the  traditional 
empirical-rule-ba.sed  approach  [1,2,7]. 

VMES  consists  of  five  modules:  the  knowledge-base;  the  inference  engine; 
the  active  databa.se;  the  end-user  interface;  and  the  intermediate-user  interface 
(Fig.  l).  The  knowledge-base  is  implemented  as  an  expandable  component  library 
which  contains  component  descriptions.  The  inference  engine  has  the  generic 
diagnosis  knowledge  of  the  domain,  and  uses  the  SNIP  semantic  network  infer¬ 
ence  package  of  S.N’cPS,  the  semantic  network  processing  system,  as  its  basis  [5, 3]. 
An  active  database  is  created  and  updated  throughout  each  diagnostic  session  to 
keep  the  instantiated  objects  and  their  associated  diagnostic  states  and  values. 
The  end-user  interface  interfaces  the  maintenance  technicians  when  carrying  out 
a  diagnostic  session.  The  intermediate-user  interface  interfaces  the  engineers  or 
senior  technicians  to  update  the  knowledge-base  for  new  devices.  All  these  five 
modules  are  implemented  on  top  of  SNePS. 

As  knowledge  engineering  is  to  empirical-rule-based  systems,  device 
modeling/representation  is  the  key  to  the  success  of  a  device-model-based  fault 
diagnosis  system,  since  knowledge  about  the  structure  and  function  of  a  device  is 
the  major  knowledge  source  of  reasoning  in  such  a  system.  Consequently,  our 
efforts  are  focused  on  the  develt^mient  of  a  device  representation  forrr.alism  for 
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versatile  nuintenance.  All  knowledge,  whether  of  structural,  functional,  or 
graphical,  is  in  a  unified  knowledge  base  (Fig.  2),  which  is  easily  expandable  and 
•s  referred  as  a  “component  library". 


User  interaction  is  an  important  issue  of  the  VMES  project  in  two  aspects: 
VMES  has  to  communicate  with  the  maintenance  technician  for  test  and  repair, 
and  it  has  to  provide  an  engineer  or  a  senior  technician  facilities  for  adapting  it 
to  other  devices  by  adding  their  descriptions  to  the  component  library,  in  the 
next  section,  the  VMES  device  represenution  scheme  is  described  with  the 
emphasis  on  device  representation  which  faciiiutes  a  better  user  interaction.  Sec¬ 
tion  3  discusses  the  knowledge-based  graphics  package  of  VMES,  which  main- 
uins  and  reasons  on  “graphical  deep  knowledge”  when  interacting  with  the  user. 
Section  4  is  the  conclusion. 

DEVICE  REPRESENTATION 

In  VMES,  a  device  is  modeled  as  hierarchically  arranged  modules.  While  this  is 
hardly  a  new  idea,  the  innovative  part  of  our  work  includes:  the  use  of  an 
expandable  component  library:  a  clear  distinction  between  two  levels  of  abstrac¬ 
tion  of  an  object;  representing  a  component  “type**  as  an  instantiation  rule  and  a 
structural  template;  an  explicit  representation  of  wires  and  points  of  contact 
(POOONs);  and  the  incorporation  of  logical  and  physical  structure  of  devices  for 
both  diagnostic  reasoning  and  u-ser  interaction. 

General  R^eserttation  Scheme 

Devices  in  the  digital  circuit  domain  share  many  common  component  types. 
Representing  every  detail  of  a  device  causes  much  representation  overhead,  which 
in  turn  leads  to  system  inefficiency,  instead  of  coding  each  device,  we  only 
describe  the  component  types  used  by  the  device  to  the  componein  library.  Parts 
of  a  device  are  insuntiated  as  needed.  Adapting  VMES  to  a  new  device  is  an 
easy  task  —  just  adding  to  the  component  library  those  component  types  used  by 
the  new  device  and  not  already  in  the  component  library.  Since  the  representa¬ 
tion  scheme  is  still  being  experimented  with,  we  currently  have  only  about 
twenty  different  component  types  in  the  component  library. 

A  component  type  is  abstracted  at  two  levels.  At  level-1,  it  is  a  module 
(black  box)  with  I/O  ports  and  a  functional  description.  At  level-2,  its  subparts 
and  connections  are  described.  In  a  previous  irhplementation,  these  two  levels 
were  represented  as  two  instantiation  rules  [7].  Since,  usually,  only  a  few  sub¬ 
parts  of  an  object  are  relevant  to  further  diagnostic  investigation,  instantiating 
all  'subparts  is  inefficient.  As  an  improvement,  the  two  levels  are  now 
represented  as  an  instantiation  rule  and  a  structural  template  [lO].  An  instantia¬ 
tion  rule  instantiates  an  object  with  its  ports  and  functional  associations.  A 
structural  template  is  a  piece  of  passive  knowledge,  which  allows  VMES  to 
search  the  suspicious  subparts  of  an  object.  Unlike  other  procedural  representa¬ 
tions  of  the  level-2  abstraction  [1,7],  the  structural  template  itself  is  never  fired 
or  copied.  Since  the  investigation  of  a  suspect  is  often  terminated  without  check¬ 
ing  its  subparts,  the  clear  distinction  of  the  two  levels  of  abstraction  along  with 
their  separate  representation  has  advantages  on  diagnosis  and  representation 
efficiencies. 

Explicit  representation  of  wires  and  P(XX>Ns  is  necessary  for  diagnosing 
faults  of  circuit  connections  [ll}.  The  traditional  model  of  a  wire  as  a  uni¬ 
directional  module  is  inappropriate,  because  it  ignores  its  bi-directional  nature, 
and  it  does  not  include  POOONs.  In  'VMES,  a  wire  is  modeled  as  a  bi-directional 
module  to  preserve  its  physical  property,  and  its  uni-directional  design  intention 
is  retained  by  the  connection  mechanism.  Components  are  connected  either  by 
forming  a  POOON  from  two  different  ports  or  by  superimposing  two  ports, 
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which  are  a  same  port  abstracted  at  two  different  hierarchical  levels,  together. 
With  this  new  model,  VMES  is  able  to  locate  interrupted  wires  and  bad  contact 
points. 


Human  diagnosticians  of  electronic  devices  seem  to  simultaneously  maintain 
models  of  the  logical  and  physical  structures  of  the  urget  device.  They  carry  out 
most  of  the  diagnostic  reasoning  over  the  logical  structure  of  the  device  due  to  its 
functional  association.  While  carrying  out  the  reasoning,  the  logical  structure  is 
apparently  mapped  to  the  physical  structure  from  time  to  time.  Tests  and  meas- 
u remen  r  are  first  initialized  using  the  logical  structure,  and  then  are  realized  and 
executed  on  the  physical  structure.  Repair,  which  is  usually  done  by  replacing  a 
physical  unit  or  by  fixing  a  physical  connection,  is  planned  and  done  on  the  phy¬ 
sical  structure.  In  other  words,  maintenance  technicians  use  a  model  of  physical 
structure  of  the  target  device,  which  is  a  hierarchically  arranged  set  of  replace¬ 
able  physical  components  at  various  maintenance  levels  such  as  field-level  and 
depot-level.  By  mapping  the  logical  structure  of  the  device  to  its  physical 
equivalent,  maintenance  technicians  are  able  to  terminate  the  diagnostic  process 
at  the  right  moment  and  to  form  an  adequate  repair  plan. 

Given  that  the  mapping  between  the  logical  structure  of  the  device  and  its 
physical  equivalent  happens  throughout  the  diagnostic  process  at  all  hierarchical 
levels,  the  speed  in  carrying  out  the  mapping  is  critical  to  the  time  needed  to 
locate  faults.  This  implies  that  (Ejects  on  both  the.  logical  structure  and  the  phy¬ 
sical  structure  of  the  device  should  be  closely  linked  to  each  other  so  that  the 
mapping  is  done  efficiently.  Even  experienced  technicians  may  have  difficulty  in 
locating  a  point  of  a  schematic  diagram  on  the  real  device,  where  the  schematic 
diagram  represents  the  logical  structure  of  the  device,  and  the  form  of  the  real 
device  is  the  physical  structure;  which  Is  attributable  to  the  large  difference 
between  the  logical  and  the  physical  structures  and  a  lack  of  cross-links  at  all 
hierarchical  levels  of  the  device  in  human  memory.  On  the  other  hand,  when 
modeling  an^  representing  a  device  in  an  automatic  fault  diagnosis  system,  the 
cross-links  between  its  logical  structure  and  physical  structure  can  be  modeled 
and  represented  to  an  appropriate  level  of  deuil.  This  is  indeed  possible  to  do  in 
a  computer  with  reasonably  sized  memorv. 

in  VMES.  the  physical  structure  ol  a  device  is  represented  distinctly  from 
but  in  a  similar  way  as  its  logical  structure.  In  a  structural  template  for  a  logi¬ 
cal  component  type,  every  subpart  of  the  component  type  is  specified  with  a  sub¬ 
part  ‘'id”  and  a  subpart  "type”,  which  are  used  to  instantiate  the  subpart  if  it  is 
found  to  be  a  suspect  and  further  investigation  of  it  is  necessary.  In  addition  to 
the  subpart  “id"  and  “type”,  an  “mntn-Iv”  indicator  is  also  associated  .with  every 
.subpart  of  a  phy.sical  component  type.  The  “mntn-lv”  indicator  shows  the 
intended  maintenance  level  of  the  subpart,  i^;,  the  maintenance  level  where  the 
subpart,  if  found  faulty,  is  replaced  without  further  diagnosis.  '|*he  “mntn-lv" 
indicator  is  associated  with  the  physical  structure  rather  than  the  logical  struc¬ 
ture  of  a  device  to  reflect  the  fact  that  human  experts  form  and  carry  out  a 
repair  plan  based  on  a  physical  model  rather  than  a  logical  model  of  the  device. 

In  order  to  abstract  a  device  into  a  model,  which  can  be  efficiently 
represented  and  interpreted,  some  abstraction  restrictions  have  to  be  made.  First, 
the  hierarchical  trees  abstracted  from  the  two  perspectives  should  have  the  same 
number  of  hierarchical  levels.  Second,  the  cross-links  can  only  be  made  at  the 
same  hierarchical  level.  Third,  several  logical  objects  on  the  logical  structure  can 
correspond  to  the  same  physical  object  on  the  physical  tree,  but  a  logical  object 
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can  not  spread  over  several  physical  objects,  lliis  restriction  seems  unreasonable 
at  first,  but  a  closer  investigation  of  the  electronic  domain  shows  the  contrary  — 
physical  objects  in  the  domain  usually  have  larger  grain  si/e  than  logical  objects. 
This  is  especially  true  with  modern  technology  as  more  and  more  logical  func¬ 
tioning  units  are  being  packed  into  a  physical  unit,  e.g.,  a  simple  Hexinverter  chip 
(a  physical  object)  contains  six  independent  inverters  (logical  objects). 

Cross-links  between  Representations 

'Phe  two  representations  of  the  logical  and  the  physical  structures  of  a  device  are 
cross-linked  at  every  hierarchical  levels.  'Iliere  are  two  kinds  of  cross- 1  inks 
between  the  logical  structure  and  the  physical  structure  of  a  device.  'Hie  first 
kind  are  cross-links  for  components,  llie  .second  kind  are  cross-links  for  ports. 
Cross-links  for  components  are  implemented  by  the  “object <logicato6j>/ 
inside<phystc<iZ/>bj>'' semantic  network  ca.se-frame  (I'ig.  3(a)).  .No  distinction  is 
necessary  as  to  whether  the  physical  object  contaias  a  single  logical  object  or 
.several  logical  objects.  This  Is  because  we  just  care  about  whether  the 
corresponding  physical  object  of  a  faulty  logical  object  Is  at  the  intended  mainte¬ 
nance  level  and  should  be  replaced,  or  it  is  not  and  the  diagnostic  process  should 
continue:  this  is  independent  of  whether  the  physical  objects  conuias  anything 
else.  (Actually,  a  physical  object  in  the  electronic  domain  is  often  replaced  with 
most  of  its  parts  being  intact) 


Figure  3  Representation  of  cross-links  between  the  logicai 
and  the  physical  structures  of  a  device. 

(a)  Component  cross-links,  (b)  Port  cross-links. 


While  the  cross-links  of  components  helps  in  determining  if  the  diagnostic 
process  should  go  on  or  terminate,  and  in  forming  a  repair  plan,  the  cross-links  of 
ports  makes  user  interaction  much  easier  —  when  ordering  a  test  or  a  measure¬ 
ment  it  can  be  used  to  clearly  direa  the  user  to  the  right  location  on  the  real 
device.  It  is  implemented  by  the  *‘objcct<togica(.pori>/equiv<physica£.pori>" 
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semantic  network  case-frame  (Hg.  3(b)).  The  advanuge  of  a  logical  abstraction 
of  the  device  is  that  it  provides  a  high  level  view  of  the  device  which  facilitates 
the  diagnostic  reasoning.  For  instance,  a  n*bit  wire  is  abstracted  as  a  single  logi¬ 
cal  wire,  thus  freeing  the  technician  (or  a  fault  diagnosis  system)  from  thinking 
about  bit  slices.  However,  when  a  measurement  is  required,  it  is  necessary  to 
locate  all  the  bit-ports  on  the  real  device,  and  this  is  often  a  difficult  task  since 
these  bit-ports  may  spread  out  randomly.  In  our  representation  (Fig.  3(b)),  these 
bit-ports  (physical  ports)  are  linked  together,  from  high-order  bit  to  low-order 
bit,  by  the  recurrent  case-frame  of  “\n\.<a.phyncaLport>/ 
labit  KthesenudningJoaterJbUs  >**. 

Physical  Representation  at  Work 

In  the  rest  of  this  section,  we  describe  how  VMES  uses  this  device  represenution 
to  faciliute  fault  diagno^  and  user  interaction.  When  bad  outputs  are  found  in 
the  suspect  currently  being  investigated,  the  system  has  to  determine  if  the  diag¬ 
nosis  should  terminate  or  not.  Ktot  fault  diagnosis  systems  use  the  simple  idea 
of  SRU  (smallest  replaceable  unit)  which  says  that  the  diagnostic  process  stops 
when  the  current  suspect  is  a  SRU.  Le^  a  terminal  node  (a  leaf)  of  the  structural 
hierarchical  tree  of  the  device  [1.2].  VMES  takes  a  more  flexible  approach  by 
incorporating  the  idea  of  “intended  maintenance  level"  into  the  system.  A  sys¬ 
tem  parameter.  VMESJML,  is  set  to  the  "intended  maintenance  level"  the  system 
is  working  on.  If  a  part  shows  some  bad  outputs  and  it  is  at  the  intended  mainte¬ 
nance  level,  it  ts  declared  faulty  and  the  diagnosis  on  it  is  terminated.  For  exam¬ 
ple.  a  board  is  replaced  at  Jidd  and  then  sent  back  to  a  depot  where  the  fault  is 
further  isolated  to  a  chip.  The  checking  for  the  maintenance  level  of  a  part  is 
done  on  the  corresponding  physical  objea  of  the  part  (a  logical  object),  and  a 
repair  plan  is  formed  based  on  the  cmnponent  type  of  the  physical  object.  VMES 
also  provides  an  opportunity  for  the  user  to  .short-cut  the  diagnosis  by  noticing 
that  all  remaining  (logical)  suspects  are  in  a  single  replaceable  physical  unit  at 
VMES.IMi.  Since  the  same  physical  object  gets  replaced  no  matter  which  logical 
suspect  is  faulty,  further  discriminatum  among  the  suspects  are  unnecessary  pro¬ 
vided  that  connectioas  are  assumed  to  be  intact. 

'ITie  major  interaction  between  VMI-S  and  the  u-ser  is  the  input  of  port 
values.  Since  diagnostic  reasoning  is  carried  out  on  the  logical  model  of  the  dev¬ 
ice.  VMES  always  wants  the  value  of  a  logical  port.  'Hirough  the  cross-links 
lietween  logical  and  the  physical  structures,  VMES  is  able  to  inform  the  user 
which  "physical  ports"  should  be  mea.sured  for  a  logical  poru  Note  that  in  digital 
circuits,  a  logical  port  may  corresponding  to  several  randomly  spread-out  phy.si- 
cal  ports  (or  pins  of  chips).  Two  examples  of  how  the  physical  represenution  of 
a  device  helps  the  user  in  executing  a  port  value  measurement  are  shown  in  I'ig. 
4.  The  port  to  be  measured  in  Mg.  ^a)  is  a  port  of  a  aimmon  component  (non- 
wire  component):  and  the  one  in  Mg.  4(b)  is  a  hi-dircciiunal  port  (a  wire-end)  of 
a  wire.  Eor  represenution  and  display  efficiencies,  wires  are  e.vcluded  from  the 
physical  represenution  of  a  device;  this  does  not  hurt  the  user  interaction  since 
the  wire-end  of  a  wire  can  always  be  identified  as  the  wire-end  connected  to  a 
port  of  a  common  component  in  the  physical  represenution  as  sliown  in  Mg.  4(b). 
Note  that  two  kinds  of  values  a  user  can  type  in:  decimal  and  binary,  where  the 
binary  numbers  are  prefixed  by  the  letters  "11"  or  “b".  'Hie  user  interaction 
shown  in  l-'ig.  4  is  through  pure  text  in  SNePSUL  (SNeI*S  User  Language)  format, 
it  can  be  improved  by  implementing  it  in  natural  language  and  graphics  [8]. 
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what's  the  value  of  port 

(m316  (signal  (mix  (bit-width  (4)}  (type  (D)))} 

(W  (inp2))  (port-of  (D1-A2))  (type  (l-PORT))) 
Equivalent  Riysical  Port  from  Hi-bit  to  Lo-bit; 
(m398  (id  (2))  (type  (P-PORT))  (port-of  (D1  -U2))) 
(m399  (kJ  (4))  (type  (P-PORT))  (port-of  (D1-U2))) 
(m400  (id  (6))  (type  (P-PORT))  (port-of  (D1-U2))) 
(m401  (id  (8))  (type  (P-PORT))  (port-of  (D1-U2))) 

*  (valuej/nil?  80110 

(a) 


what's  the  value  of  port 

(m291  (signal  (m35  (bit-width  (2))  (type 


-PORT))) 

Lo-bit; 


(m427(id 
(m428  (id 


'type  (P-PORT))  (port-of  (D1))) 
[type  (P-PORT))  (port-of  (D1))) 


*  (valuel/na?  2 

(b) 

Figure  4  Asking  a  port  value  measurement,  (a) 
On  a  common  component  (b)  On  a  wire. 


>»»  lOOnHEFAULTYPARIBAS  »»> 

(01-M2) 

^  Rep^  Order,  replace  01 -US  (typeMCOO) 
done 

(a) 

>»»  IQOnHEFAULTYPARTSAS  »>» 

(01-W1) 

$$  Repair  Order,  fix  the  wire  connecting 
(m420  fid  (4))  (type  (P-POR;n)  (port-of  (01))) 

(m389  (id  (8))  (type  (P-PORT))  (^rt-of  (01 -03))) 

(m429  (id  (4))  (type  (P-PORT))  (port-of  (01 -U3))) 

$  and  also  m  wire  connecting 
(m419  fid  (3))  (type  (P-PORTT)  (port-of  (01))) 

(m388  (id  (10))  (type  (P-PORT))  (port-of  (01 -U3))) 

(m428  (kJ  (2))  (type  (P-PORT))  (port  of  (Dl  -U3))) 
done 

(b) 

>»»  IQOnHEFAULTYRARrSAS  »»> 

(m324  (contact  (m322  (signal  (m35  (bit-width  (2))  (type  (0)))) 

(id  (3))  (port-of  (01  -W1 ))  (type  (B-PORT))) 
(m323  (signal  (m35  (bit-width  (2))  (type  (0)))) 

fid  (inpl))  (port-of  (01 -M2))  (type  (l-PORT))))) 
$$  Repair  Order:  fix  the  contact  point  at 
(m388  fid  (10))  (type  (P-PORT))  (port-of  (Dl  -U3))) 
done 

(c) 

Figures  Repair  suggestion  made  by  VMES.  (a)  On  a  com¬ 
mon  component  (b)Oiawire.  (c)OnaPOCON. 
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The  third  use  (rf*  the  physical  representatioa  of  a  device  is  in  repair  sugges¬ 
tions.  When  a  faulty  object  is  found  or  at  the  end  of  the  diagnosis  session,  VMES 
suggests  a  repair  plan  to  the  user  according  to  the  type  of  the  faulty  object  (Fig. 
SX  If  the  faulty  object  is  a  common  component,  VM^  just  suggests  that  the  user 
replace  its  oorresptuiding  physical  part.  If  it  is  a  wire,  the  corresponding  physical 
wires  are  identified  for  repair.  Note  that  a  logical  wire  may  correspond  to  several 
physical  wires,  for  example,  a  4-bit  logical  wire  is  realized  by  four  wires  on  a 
printed  circuit  board;  only  the  physical  wires  which  are  responsible  for  the  fault 
are  identified  for  repair.  This  is  done  by  decomposing  the  port  value  of  a  logical 
wire  into  Ut  slices  to  determine  which  bit(s)  are  giving  incorrect  values. 
Finally,  if  the  faulty  object  is  a  POCX)N  (point  of  contact  [ll]).  that  is,  it  is  a  bad 
contact  point,  the  user  is  directed  to  the  location  of  the  contact  poinL  The  physi¬ 
cal  represenution  is  not  only  used  to  form  the  repair  plan,  it  also  helps  direct  the 
user  to  the  object  or  the  location  on  the  real  device  where  the  repair  is  actually 
performed.  In  other  words,  it  provides  for  better  user  interaction  in  both  test  and 
repair. 

THE  INTELLIGENT  USER  INTERFACE 


General  Rarnarks 

As  described  in  (7]  VMES  contains  a  knowledge  based  graphics  package  .which  is 
used  as  part  of  the  VMES  user  interface.  The  purpose  of  this  part  of  the  VMES 
project  is  to  investigate  new  designs  for  user  interfaces,  and  to  investigate  what 
we  have  called  ‘Graphical  I>ep  Knowledge”.  We  consider  a  knowledge  represen¬ 
tation  system  to  be  dealing  with  Graphical  Deep  Knowledge  (as  opposed  to  graph¬ 
ical  knowledgeX  if  the  knowledge  is  oi^anized  in  a  way  that  makes  it  accessible 
not  only  to  display  routines,  but  also  supports  some  form  of  graphical  rea.soning 
with  this  knowledge. 

Naturally,  a  procedural  knowledge  paradigm  is  not  acceptable  for  Graphical 
Deep  Knowledge.  While  many  graphics  systems  eliminate  all  information  not 
essential  to  the  purpose  of  display,  our  system  oonuins  prima-fade  “redundant” 
information  that  is  not  imm^iately  necessary  for  display  purposes.  However, 
we  have  found  good  reason  to  maintain  this  additional  knowledge  and  have  at 
least  four  reasons  w'hy  additional  knowledge  adds  to  the  power  of  a  representa¬ 
tional  system. 

(1)  It  is  helpful  for  a  system  to  know  what  is  currently  visible  on  the 
screen.  A  graphiail  representation  looses  much  of  its  power  if  the  user 
cannot  refer  to  the  objects  shown  by  that  representation.  One  can  con¬ 
vince  oneself  easily  of  the  importance  of  this  notion  by  looking  at  virtu¬ 
ally  any  system  of  gniphical  representation  (including  the  diagrams  in 
this  paper).  'Hte  given  figures  are  always  referred  to  by  .some  text  and 
derive  their  explanatory  power  from  this  interaction  with  the  text. 
However,  this  re(|uires  that  the  system  think  in  the  .same  relations  as  the 
user  and  maintain  the  same  conceptual  units  as  he  dues. 

(2)  Declarative  represeniatioas  are  required  for  any  logic  based  rca.stming. 
'Iliis  factor  has  been  the  prime  motivation  for  the  represen uitiona I  t(x>ls 
developed  here.  An  example  of  a  simple  rea.soning  operation  would  be  a 
situation  where  the  position  of  one  object  01  is  known,  and  it  is  also 
known  that  this  object  has  an  indeterminate  spatial  relation  to  another 
object  02,  like  e.  g.  leftness.  Any  person  could  immediately  derive  from 
these  facts  that  the  object  02  must  therefore  be  somewhere  to  the  right  of 
Ol.  and  any  system  that  could  not  follow  this  step  of  reasoning  would  be 
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considered  by  a  user  as  not  intelligent.  Reasoning  in  the  domain  of 
graphics  is  especially  interesting,  because  not  only  traditional  forms  of 
logic  based  reasoning  have  to  be  investigated,  but  also  analog  reasoning  is 
of  interest. 

(.^)  Modern  software  engineering  has  made  the  concept  of  modularization 
mandatory,  and  very  often  production  programmers  divide  a  program 
into  modules,  such  that  the  user  interface  is  one  module,  and  the  host 
program  that  performs  the  services  the  user  is  really  interested  in  is 
another  module.  'I'his  leads  to  the  existence  of  an  interface  between  host 
program  and  user  interface  which,  according  to  methods  of  good  program 
design,  has  to  lie  kept  well  defined  and  small.  The  result  of  this  modular¬ 
ization  is  that  the  important  concepts  of  the  host  program  are  not  avail¬ 
able  to  the  user  interface,  and  vice  versa.  'I'herefore  a  user  can  only  refer 
to  units  the  system  designer  decided  explicitly  to  export  from  the  host 
program.  Knowledge  based  programming  permits  the  faring  of  informa¬ 
tion  between  different  modules  without  creating  a  bottle-neck,  between 
them,  and  without  having  dangerous  global  information  available  to 
several  modules.  Tlie  reason  why  a  knowledge  base  is  not  anywhere 
near  as  dangerous  as  the  sharing  of  global  variables  is  that  knowledge 
bases  are  dealing  with  facts  that  are  considered  generally  true,  and  if  a 
fact  is  true  there  is  no  reason  to  keep  it  private  to  a  single  module,  and 
little  danger  of  conflicting  definition  or  access.  This  last  statement  is  espe¬ 
cially  true  for  rule-ba.sed  systems.  A  rule  expressing  that  A  is  left  of  K  if 
and  only  if  B  Is  right  of  A  is  a  universal  truth  that  can  bo  made  avail¬ 
able  to  any  module  in  any  system. 

(4)  If  a  knowledge  based  system  supplies  tools  for  natural  language  interac¬ 
tion  a  knowledge  base  containing  Graphical  Deep  Knowledge  becomes  in 
an  interesting  sen.se  an  interlingua,  namely  an  interlingua  between  the 
visual  and  the  linguistic  faculties  of  the  system.  Given  that  most 
knowledge  ba.sed  sy.stems  have  been  created  with  some  consideration  of 
natural  language  processing  this  trtservation  should  be  of  general  interest 
to  KK  research.  Specifically  the  ^ePS  system  has  a  number  of  tools  for 
natural  language  processing  which  permit  the  implied  interactions. 

^me  ocher  comments  on  the  uuse  of  knowledge  based  methodologies  in  user 
interface  design  can  be  found  in  (4]  and  [9]. 

The  TINA  Graphics  Interface  to  VMES 

Three  user  interfaces  have  been  developed  for  the  VMES  system  which  are  in 
diflFerent  states  of  completion  and  integration  with  the  maintenance  reasoning 
program.  The  first  interface  is  the  “TINA"  program  for  knowledge  based  image 
generation.  This  program  maps  a  declarative  knowledge  structure  into  a 
diagrammatic  representation  on  a  visual  display  device.  'Htis  module  exists  in 
two. versions  with  different  focus,  one  of  which  has  been  used  in  the  past  by  the 
maintenance  reasoner  to  inform  the  user  about  the  current  state  of  the  diagnosis 
process.  Details  of  this  representation  have  been  reported  elsewhere  {?],  but  it 
should  be  pointed  out  that  symbol  colors  are  an  important  a.spect  of  this  represen¬ 
tational  facility. 

It  is  relevant  to  the  discussion  of  TINA  that  an  important  mode  of  display 
for  which  the  theoretical  ground  work  has  been  layed  in  this  project,  called  the 
Intelligent  Machine  Drafting  mode,  has  been  developed.  Traditional  CAD  sys¬ 
tems  for  circuit  boards  are  usually  concerned  with  the  maintenance  of  graphical 
representations  of  wire  plans  that  show  a  physical  picture  of  the  device.  In 
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contrast,  techniciaiis  usually  locdt  (also)  at  logical  wire  plans.  Logical  wire  plans 
are  interestingly  different  from  physical  ones  in  that  no  absolute  positions  for 
components  need  to  be  matnained.  only  ceitain  connectivity  relations. 

Nevertheless  it  is  possiUe  to  draw  the  same  wire  plan  in  two  different 
ways  such  that  one  of  them  brings  across  the  idea  of  the  representation,  and  the 
other  one  doesn’t.  It  is  the  goal  of  UNA  in  IMO  ntode  to  create  a  logical  diagram 
that  is  ‘easy  to  read‘,  by  laying  it  out  and  routing  it  not  according  to  prindples 
of  CAD  like  minimization  of  energy  consumption,  but  according  to  principles  of 
minimal  cognitive  complexity.  The  most  impottant  such  principle  that  has  been 
used  is  the  equal  distri^ioh  of  structure  in  the  given  space. 

It  goes  without  saying  that  a  knowledge  base  for  use  withiMD  mode  does 
not  contain  any  knowledge  of  coordinates,  and  that  the  major  effort  in  the  pro* 
cess  of  display  is  the  reconstructkm  of  this  knowledge  from  hierarchy  and  Con* 
nectivity  infornution.  The  abilities  of  the  IMD  module  in  use  are  limited  tp  a 
small  device  class  that  we  refer  to  as  A*)iil*  and  which  has  been  modeled  around 
the  ‘Adder'Multiplier"  (Fig.  6X  a  device  famous  in  the  maintenance  literature. 
A*M*  permits  small  variations  of  the  Adder^ultiplier.  for  insunce  variations  in 
the  number  of  ports  per  amponents,  in  the  number  of  components  per  row.  in 
the  number  of  processing  rows,  and  in  the  number  of  connections  per  port.  A 
formal  description  of  the  device  class  has  to  be  omitted  due  to  limitations  of 
space. 


Figure  6  A  3-multipHer/2-adder  board. 


The  Readform  Interface  for  Object  Creation 

'Hie  second  interface  is  the  “Keadform"  program  which  is  used  for  the  creation  of 
visual  icons  in  a  format  that  is  accessible  to  the  knowledge  representation  system- 
Hiis  avoids  the  necessity  of  hand  generation  of  graphics  code.  'I  he  compilation  of 
a  larger  pictorial  unit  is  done  bv  asserting  information  about  objects  in  the  net¬ 
work.  such  that  in  the  prtKess  of  drawing  access  is  made  to  the  icons  created  by 
Readform.  A  knowWge  based  version  of  Readform  has  been  in  the  process  of 
development  for  some  time,  however  as  of  this  writing  only  the  theory  of  this 
system  will  be  claimed. 

By  observing  users  in  the  process  of  object  creation  (with  Vanilla  flavored 
Readform)  it  has  become  obvious  that  the  internal  conceptual  structures  of  the 
person  can  to  a  certain  degree  be  derived  from  the  order  of  his  actions  as  well  as 

by  asking  a  few  questions  at  strategk;  points.  Readform  supplies  the  user  with  a 
scratch  buffer  which  is  separate  from  the  object  created  at  the  current  moment. 
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Users  have  been  observed  to  create  objects  by  drawing  a  simple  unit  in  the 
scratch  buflPer  and  then  repeatedly  yanking  the  buffer  content  into  the  picture. 

From  this  chain  of  actions  one  can  derive  that  all  the  yanked  objects  are 
presumably  members  of  a  ceruiii  class,  and  the  system  can  verify  this  by  asking 
the  user  whether  there  is  in  fact  .such  a  class,  and  if  so,  how  to  name  it.  This 
information  can  be  used  to  create  exactly  the  Graphical  I>eep  Knowledge  Struc¬ 
tures  that  have  been  mentioned  before  as  being  used  for  picture  generation. 

The  other  thing  that  can  be  derived  from  the  above  chain  of  user  interac¬ 
tions  is  that  all  the  yanked  icons  are  presumably  parts  of  a  larger  object  which 
consists  of  all  the  iconic  primitives  (lines,  arcs,  etc.)  which  were  not  created  by 
using  the  scratch  buffer,  'fhis  permits  a  system  to  ask  the  user  whether  he 
wishes  to  name  this  larger  object  separately,  and  if  he  desires  .so,  a  part  relation 
between  the  yanked  parts  and  the  main  structure  can  be  formulated  and  stored 
in  the  knowledge  base  as  a  proposition.  This  proposition  becomes  part  of  the  part 
hierarchy  in  the  knowledge  base.  Part  hierarchies  are  a  backbone  of  many 
represenutionai  systems  and  are  used  in  the  process  of  maintenance  reasoning  as 
well  as  having  major  importance  in  the  derivation  of  pictures  from  Graphical 
Deep  Knowledge  and  in  controling  complexity  of  displayable  pictures. 

The  third  user  interface  that  we  will  treat  in  this  paper  is  the  natural 
language  interface. 

The  Natytrat  ianqytage  Intyfacc 

A  versatile  maintenance  system  is  in  need  of  a  user  interface  in  two  different 
situations.  In  the  first  situation  a  maintenance  technician  uses  the  system  to  get 
help  in  troubleshooting  a  currently  faulty  device.  Ilte  second  situation  is  as 
impoitant,  namely  the  initial  creatkm  of  the  device  representation.  In  order  to 
deserve  the  title  "versatile*'  it  must  he  possible  to  create  device  representations 
with  ease  and  flexibility,  'lire  natural  language  interface  that  will  be  described 
here  belongs  to  the  second  class  of  interfaces.  It  is  the  goal  of  this  interface  to 
create  an  internal  device  representation  to  the  point  where  it  is  possible  to 
display  the  whole  device.  However,  as  much  of  this  creation  as  possible  should 
be  done  with  natural  language. 

As*  has  been  pointed  out  in  the  section  on  Intelligent  Machine  Drafting, 
there  -is  no  necessity  to  actually  enter  coordinate  information,  so  the  natural 
language  descriptions  become  quite  natural.  Natural  language  processing  is  done 
by  way  of  an  ATN  interpreter/oompiler  that  is  part  of  the  SNePS  environment 
[6}.  The  class  of  objects  that  can  be  built  by  natural  language  is  limited,  even  in 
comparison  to  the  already  limited  cla.ss  A*M*  of  displayable  devices.  The  major 
additional  limiution  that  is  imposed  by  the  language  interface  is  the  branching 
factor  of  electrical  connection.s.  It  is  possible  to  create  wires  impinging  on  at 
most  three  port, 

llelow,  the  original  set  of  sentences  that  is  understood  by  the  Nl.  interface 
and  that  describes  the:  Adder-Multiplier  will  be  presented.  Running  this  set  of 
sentences  through  the  ATN  interpreter  will  create  all  the  structures  necessary  to 
describe  the  Adder-Multiplier  completely  for  display  purposes. 

(nl) 

Dl  is  a  board 
DlMl  is  a  multiplier 
D1M2  is  a  multiplier 
D1M3  is  a  multiplier 
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DlAl  is  an  adder 
D1A2  is  an  adder 
D1  has  3  inports 
D1  has  2  ouqxms 
DlMl  ^  2  inports 
DIM]  has  1  outport 
D1M2  has  2  inpcxts 
D1M2  has  1  outport 
D1M3  has  2  inports 
DIM3  has  1  outport 
DlAl  has  2  inports 
DlAl  has  1  outport 
D1 A2  has  2  inports 
D1A2  has  1  outport 

connect  input  1  of  D1  with  input  1  or  DlMl  and  input  1  oT  D1M2 

connect  input  2  oT  D1  with  input  2  of  DIM!  and  input  1  oT  D1M3 

connect  input  3  of  D1  with  input  2  of  D1M2  and  input  2  oT  D1M3 

connect  output  1  of  DlMl  with  input  1  of  DlAl 

connect  output  1  oT  D1M2  with  input  2  of  DlAl  and  input  1  oT  Dl A2 
connect  output  1  oT  D1M3  with  input  2  of  D1-A2 
connea  output  1  of  DlAl  with  output  1  of  Dl 
connect  output  1  of  D1A2  with  output  2  of  Dl 
DlMl.  D1M2.  D1M3.  DlAl.  and  D1A2  are  parts  of  Dl 
wires  are  parts  of  Dl 
the  form  a  board  is  xbaard2 
the  form  of- a  multiplier  is  xmult2 
the  form  of  an  adder  is  xadd2 
the  form  of  a  PORT  is  xport 
end 

llie  first  (nl)  above  calls  the  natural  language  processor  from  the  SNePS  environ* 
ment.  while  the  “end  at  the  end  returns  to  the  SNePS  environment.  Although 
the  vocabularv  of  this  interface,  is  quite  limited  there  are  variations  of  the  sen¬ 
tences  shown  above  ptwsible. 

Of  special  interest  are  the  final  sentences  that  start  with  “the  form"  because 
these  sentences  call,  if  necessary,  the  before  mentioned  Readform  interface  from 
inside  the  ATN  interpreter  and  not  only  assert  the  relations  between  object  class 
and  form,  but  also  create  any  unknown  form*icons  by  having  the  user  draw  this 
icon.  If  the  form  Is  already  known  to  the  system,  then  only  the  assertional  com¬ 
ponent  of  this  operation  will  be  executed. 
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'ITiis  last  operation  involves  the  call  of  Readform  from  the  ATN  interpreter 
which  itself  runs  embedded  in  SNePS  which  itself  runs  on  top  of  Franz  LISP. 
While  display  operations  are  extremely  slow  (hours  on  a  VAX  11/750  for  non¬ 
trivial  layout  tasks),  the  natural  language  interface  works  rea.sonably  fast 
(response  times  under  a  minute)  considering  especially  the  multiple  layering  of 
the  used  systems. 

A  device  consisting  of  a  single  multiplier  with  two  inputs  and  one  output 
and  the  three  wires  needed  to  connect  the  multiplier  to  the  three  device  ports, 
plus  the  six  biports  of  the  wires  them.selves  are  laid  out  in  about  20  minutes  (Fig. 
7).  'Iliis  device  has  also  bren  created  completely  by  natural  language  interactions 
and  it  represents  a  low  end  member  of  the  A*M*  class. 

CONCLUSION 

In  diagnostic  problem  solving,  human  experts  .seem  to  u.se  both  the  logical  struc¬ 
ture  and  the  physical  structure  of  the  urget  device  throughout  the  diagnostic 
process  at  every  hierarchical  level.  Knowledge  of  the  logical  structure  of  the  ur¬ 
get  device  together  with  the  a.ssociating  functional  knowledge  is  used  for  diag¬ 
nostic  rea.soning,  and  knowledge  of  its  phy.sical  structure  is  u.sed  to  carry  out  a 
test,  to  determine  when  the  diagnostic  process  be  terminated,  and  to  form  a  repair 
plan.  It  is  important  to  incorporate  the  physical  represenution  and  the  logical 
represenution  of  a  device  in  maintenance.  We  find  that  a  physical  represenution 
of  the  urget  device,  together  with  the  represenution  of  the  cross-links  between 
the  logical  and  the  physical  structures  of  the  device,  contributes  to  fault  diag¬ 
nosis  in  several  aspects  —  such  a  system  does  not  merely  mimic  the  behavior  of 
human  experts,  it  may  outperform  human  experts  in  oeruin  situations,  it  helps 
deurmine  when  a  diagnostic  process  should  be  terminated,  thus  it  provides  versa¬ 
tility  across  maintenance  levels.  Itcan  provide  a  short-cut  to  diagnosis  by  notic¬ 
ing  that  all  logical  suqrects  are  in  a  physical  object  at  the  intended  maintenance 
level.  It  helps  to  form  a  repair  plan  based  on  the  physical  nature  of  the  urget 
device.  Finally,  (probably  the  most  imporunt  point,)  physical  represenution 
eases  user  interaction:  it  helps  direct  the  user  to  the  exact  location  in  the  real  dev¬ 
ice  for  test  and  repair. 

It  has  been  argued  in  this  paper  that  knowledge  based  methodologies  are  of 
increasing  importance  for  intelligent  systerrrs.  They  permit  intelligent  behavior 
of  the  interface  and  help  to  offset  problems  in  information  privacy  that  are 
enforced  by  modem  software  engineering  technology.  A  powerful  set  of  user 
inutfaces  is  also  a  precondition  for  a  versatile  system,  because  most  expert  sys¬ 
tems  have  to  ulk  with  people  of  different  requirements  during  their  life  cycle. 
Specifically  three  user  interfaces  have  been  introduced  in  this  paper.  The  first  one 
caters  to  the  end  user,  which  for  VMIiS  is  the  maintenance  technician.  It  creates 
graphical  represenutionN  of  circuit  boards.  The  specific  research  contribution  of 
this  part  of  VMHS  is  the  creation  of  logical  wire  plans  without  any  prior 
knowledge  about  coordinate  values  of  the  system!  icons.  The  other  two  interfaces 
are  mainly  of  u.se  for  the  device  designer  who  wants  to  enter  information  about 
a  newly  created  device  into  the  maintenance  system,  without  having  to  leam 
some  obscure  graphics  or  KK  language.  The  first  of  these  two  interfaces  permits 
the  creation  of  graphical  icons  of  new  components.  This  interface  is  called  from 
inside  the  natural  language  interface,  if  a  user  attempts  to  use  a  primitive  form 
which  was  not  previously  declared.  The  natural  language  interface  is  based  on 
the  SNePS  ATN  interpreter,  and  the  complete  necessary  natural  language  input 
for  the  creation  of  an  artificial  device  called  the  Adder-Multiplier  has  bMn 
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presented. 
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Appendix  A5: 


"Graphical  Deep  Knowledge  for  Intelligent 
Machine  Drafting" 

Geller,  J. 

Shapiro,  S.C. 
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OtfMlMM  if  CbapMr  tcinet 
Sum  (Miinlqr  if  Nnr  Y«k  «  Mdi 
MriftHYlOfO 
(dlMWMIiteiaMl-MliSr 


wteftirloii  Mtihiiwiili  wceiti  CI^bcm  iboM  wUck  Mthiag 
Mfpdic  b  Om>  kawMi  iK  tftapbjMi  hi  Mm.  Wlhifclif  b  mmt 
MilMkMt  the  CMRM  fWM  MjKS  if  dM  inXM. 

VMES  l»  imflmtmti  m  up  tt  sHM  dw  •SaiMile  >in- 
WHk  PncMiiiK  M  YlwMipliV  PHChmi  bMasriMi 

nil  h  MlM?iMligr  (i  Mt  efiiwHii  M  MCMil  hitit* 
fnMikMwMftMM. 


I*  Mi  MiM  fonmOm  V  dwcithfi  •  ■ywftfcilly  vdM  mt 
— MtoHy  M— iMprf  — ml  iM^My  iWB— wwMwd  M 
■  Mi  dnailii  M  ^  ^  ** 

ktiMr  «M  Mi  VMM  If /dGd  CM  M  ifpmteHd  Mwr  Igr 
•  rmmtm  Mm  A  pcicrtnl  >Mbmmb  Mom  Mt  mm 

•Mqr  if /f  /*CiMd  MdOK  ty  CMirmiiC  KM- 

dud  dicMriM  «t  fim*  /»  firi  Ictfr  — Mrcf  dW^wi  ■ 
MhMkiciMircMMUIlMdriiicrlMiiiMMldMjMItBMMfc 


■tfiK  CM  fWM  M  fnwfb  appUeMioi  M  Me  1 1*  »  k 
MOMaqr  MMy  Mk  Me  aic  M  SNcR  MCwatke  tHfr  !• 
MCI  oylMMieM  Mill  be  ftcem  to  Me  mM  eeedoi)  Mrcmi  ee 
eyebMfelMWMfc  TlMMaiberef|WeteMeicMbetoJ«^iM^- 
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ma>  hM  mtm4  «m  «•  Is  ••  iMMiac  iHtHi  ttam  m 
ikMMdal  paiM  «r  «lnK.  k  Mii  «•  dM  WHkiap  aKkoi  «r 
ca|iaMfWt(M4  fa  tta  mmmmi  dwc  m  4aipt  mffma  awM 

■facly  faM— taiiHiM  affa.  najafaaf  diafaWfa— faaadty 
waMmi  >  -ka  iuagt— T  pwfafaa .  mdifan  aaly  •  ataor 
kwdar  iaclMiicaiadacaifaa.llaaiitardifaTaa»lairtntwntpWfa- 
kaa~^cai  fiaM  aaiay  'haad'  Al  paakfaaw  kaaaaa  k  cuaat  be 
uaartted  aafaly  iaM  a  lyaebalfa  lapmaaewlaa.  Salviac  tMI> 
fiabhaM  by  baaaaa  ae^afaea  aae  af  <!■«  aft  the  puaqaaal  ay 
uai,  aad  paaiMy  af  (he  lamfy  ayaieai,  both  rfoauia  which 
waaieJwfi  hay  aat  yet  acfaica  wdl  «  tte  elaaMia  of  pwhita 
aiiviaf. 

A.  IMP  ftwafagait  haA^  . 

Wc  have  arila»<  a  any  Ihafaea  cfaaa  af  abJaeiacBlkd  A*kf 
which  fa  a  dayic  teanallifaa  af  dw  Afaler  Malrtplitf  af  Ftf. 
2.  aad  wc  hay  haplnawii*  a  faUy  yiaailir  kyoat  aad  loch 
cal  laaiiac  gaagfia  liar  Ihfa  cfaaa.  A  fanaal  ^cariptiaa  «f  the 
daaa  A*M*  haa  beca  faryafaul,  llawcaaf.  we  will  liaait  oar- 
adya  la  Ihfa  paper  la  aalawldy  wpliaarlaa 

—  Adevfacarclaw  AVcaadMaaTataaMa^awiaabiDet 

wMeh  fa  meamfi  «a  ba  a  laiya  baa  gcaphfadly  eoattiaiap 
aMahiwai  mirailaafarpaiw.  la  the  ahwaac  af  thfa  aaais 
ahjtca  dM  apawa  iMir  fa  aaadfaaai  Ac  awia  ahtlaec. 

—  ScaaliowlaMdijMalAaclaHAnraawcUaalaita 
para  fa  aiffcdy  flaw  fall  M  rlpkl.  wMi  aa  faaAadi  at  yy 
race. 

—  The  Mpaat  laacih*  <ra»faaaw  aaafaet  al  eaaipoaeata  a 
dpaal  hM  w  paaa  dHoaph  rma  qraraa  lapat  w  aymm  Mt' 
p^  aad  the  'dcaal  wWdi*  (aiailaaiia'  aaadcr  af  «eai> 
poacatt  that-aar  aedy  la  paralld.  aaaaaiac  aaaraat  deUy 
fw  aaary  myiinnin'rl  ait  raiH  laaaph  that  Uaew  thaiiw 
al  niaariaimi  caa  be  wadwrail  that  wiU  «t  lata  the 
plya  CMla  abjd^'faiviap  eada^  addhfaail  apaee  for'wir' 
lap. 

—  The  aMiachjKtw  wdl  Mill  Ha  para  hay  pant  Seddea 
that  theie  fa  aa  aaoaad  fayl  af  the  part  hfaiaachy.  Clhe 
para  af  the  auia  abjMt  are  ahawa  aa  Otdc  bfach  baiea  la 
Hp.X) 

Ihc  camat  hapfaaMaiatfaa  aMkaa  a  lew  addidoaU 
laaianafaaa  which  an  aat  part  af  Aa- A*M*  drdaMna.  wbkh 
howeyr  da  act  faipaai  acyR  fan  af  ptnalky  aad  wU  be 
eliailaaaad  A  Ac  IViiaiCi  AaMap  thaw  aaaaapdaaa  cm  Ihtaaa' 
awacy  af  Aa  part  dai  fw  all  aaaipaaiati  aad  Aa  aaarapdy  af 
raall  yitadaa  af  dai  —cap  aartpaaaaia  Ibrwaid  Jirapa  af 
coaaacdeaa  hay  aat  yet  beta  hapkaaaaadL 

Far  rilrirarj  aaaaaaa  they  fa  aa  *->*«»■«*  «-p  ^rapiaaiawd 
law  the  water,  thewfaw  ay  cm  da<pa  padialci^GMly  aawlv- 
able  ewea  father  aadDty.  whkh  deal  aat  aatieady.  aoaacni  a^ 
piya  Aat  the  »a»P»»  wadap  |iwddiia*  hia  aat  yet 

heea  wlydckharlTl  WaAaandDaaweUacaa-thadapfayaf 
phydcal  bawd  dfapywa  ftaai  a  kaawfadpe  baae  hay  wathratad 
oar  wwk  aa  piMideal  day  kaawladpc  (wbkh  win  te  dadaed  la 
(he  aert  McdoMl 

m  OMAPmCALPFFagypwijnmt 

A.  rva.(H„-  of  Oraahfaal  Ppf  pCwiwlBdfC 

A  larpc  aaadter  af  acfaatMk  Cdda  awke  Watplail  aa  ytea- 
ay  mtcatcaw  abaat  the  iipHwaiaHi  of  kaawfadpe  dealiap 
whh  forwa  aad  aalara.  Spare  UaUta  m  to  awattaa  Aim  ewia 
aicat  aatani  laapmpr  piaphfai  (ill  kaawfadp»  bned  praphici 
(12.IA  aad  the  iaupenr  debate  betwaca  laMpfaaf’  (1AI5]  aad 
~prapaeitioaalfacf  (16,171 .  The  wfateane  af  tame  peapodtioael 
reprewatadona  fa  aow  widely  arypted  la  ail  campa  However. 


Mdaa.  >at  aadap  Aat  paahfaA  aa  md  aa  aaaM  be  daad’wkb  a 
Ifat  af  peepaddeM  Kaadyah  Iwplraratulaia.  a  aaaMa  tamp 
tiea'(l4l  iaipUre  aa  laipnraar  frill liua  far  a  pypaddaaal 
Kpecacatatfaa  af  fnraw,  aawriy  tte.it  caa  he  aaad  aa  cnaic 
aeiaal  pkcaiaa.  We  weak  y  cdl  Ala  criieriM  prajetriy  ede- 

A  ayacai  that  afaa  perwite  raaiaalap  baaed  aa  ahapea  ar 

podtioMafcbjeclawnibeaaldyAMnnatiatedfdaertypwaiA* 

cad  adapiacy.  ibe  typeaf  wiiaiafap  pciBltiad  fa  either  aaalapi 
cal  or  peoporitieaaL  la  order  Co  avoid  aay  poarifalc  tetaelaafapical 
caafaafaaa  we  wUI  Aaa  the  tetaw  *hpatial  kaowfadpe'*.  ^viaual 
kBawfadpe*  aad  eya  *;praphkal  kaowfadpe"  aad  aae  the  acroi 
"ptaphleal  deep  kaawfadpe" . 

Dcf:  Giaphieal  Deep  Kaewfadpe 

A  kaawfadpe  baae  fa  aeid  to  ooataia  ptaphioU  deep 
kaowfadpe  If  at  Icoat  parf  of  Ha  kaawfadpe  cahibitc  deduc- 
tiy  piapldeal  adaqaacy,  aad  part  of  Ha  kaowfadpe  crhlbitt 
peojccilve  odapaoQf. 

The  tcraa  ‘HaepT  fa' aaad  la  oaalepy  with  deep  ainietarei  la 
liopafaika. 

Om  OMjgr  poal  of  car  leieaiA  fa  to  cfeete  a  baae  af  pnephi* 
cal  deep' kaowfadpe  that  fa  odepaaer  far  diapUyInp  aad  lewealap 
aboat  AJaele  la  peaerd  aad  ehoat  the  dooMla  of  droolt  boaida  la 
paftkolat.  Oar  catieat  aaalyafa  af  pfaphkal  deep- kaowfadpe  fa 
plvca  la  Ac  foUowiap  iirriaM 

B.  BaokJEaaxicdch 


Objacti  BMy  hay  iadlvtdaal  fame  or  iaherited  foma. 

wK  AJeetdl  foey  aaad  aeadaUty  faarrion)  (1) 

aG(  Ajectdktypeaad-paacawdaihy  foaetloa)  (2) 

ia3(mVcfaaBaad^ttdaaibaeleaa.aaodality  foaedoa)'  (3) 
aadCcUw  tool  tea  farae  aboaliaa  awdalky  faacdoa)  (4) 


(Odaeribcaaa-abjBctQadMdaaOdt  Aathaaaforainad.  The 
fait  biaaiy  predicate  'baadaliiy"  fa  aaad  «  dbcriiaiaate  betwaca 
dUrcfcat  aaodcA  O*^  bearde  pemh  diiplay  ef  thdr 

wife  plaa  (lapfaal  ar  lhacrioaal  repicacatitlaa)  aad  af  thdr  phy> 
deal  aBocaaie,  Ihe'lbrya  aaad  far  Acae  two  dtaplaya  arc  oaa* 
ally  Afcreat,  Acrefow  Ac  farai  pebpariAai  moat  be  ^oalUfad  by 
Ac  dlaplay  awdtlHy  for  whkh  Ak  fiaai  af  kaowfadpe  fa  valid. 

A  farw  Hite  "raaiT  fa  at  the  laaac  tbee  a  node  la  the 
acawatfa  act  aad  a  USF  lhaeitaa  that,  if  CMcated.  would  drew  a 
epadfc  forak  Feia  ftiafttoM  are  parwarteriaed  by  the  atardap 
podtioa.  Thcrefoy  om  farae  fOoctioa  caa  dkplay  the  eacee 
Aject  at  ASdcM  podttooA  bat  M  ether  awdiSeatiiM  fa  poaiible. 

(2)  aadpM  dS  to  Ac  daea  ef  aad-^tei  whkh  are  by  (3) 
reoopafaed  aa  a  Mb  dear  ef  ctaei  ef  booiean  curopowcata 
whkh  by  (4)  are  all  eaeipned  Ac  mw  farm,  aaowly  rbooleaa. 
Wc  hay  aeyr  found  It  noeeaiary  «  inherit  a  fora  udnp  an 
laieraediatc  deer. 

C  ^a^Wm  Syprinrratlmi 

A  faipe.aaaebcr  ef  icprcaeataffaM  for  poririoM  fa  peaaifafa. 
All  AJeet  peeitieM  refer  tt  the  peaitiaa  ef  aa  objeefa  fixed  refer- 
caccprac 

1.  Genceaia  uA  Fnaxy  AbaeltMa  PoaltionB 

odtAJectdl  abapoinifil  x  l<io  y  200)  oMdality  functioo)  (5) 

(S)  dcecribei  aa  abaelute  peiitioa  of  d1.  The  poritiea  fa  piven  by 
the  wfaacnKtuic  m6  which  eootaiM  actual  ooordioate  yluca: 
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Tkc  pKudo  pcedicaie  016  has  lo  be  lead  as  a  atmcntred  indivi¬ 
dual.  MC  as  a  prapoMou  (6l  The  iaiplidt  aiaplion  of  thii 
icpseaeataiiou  Is  that  eoordiaaus  aic  fhm  lu  piidsaf  a  fiapliics 
diqilay  device  aad  aic  *VeUtive  (a  the  Kreen*.  tad  theicfoic 
called  ataolute^ 

Wbc«  people  five  a  deKiiptioa  of  a  ptetuie.  they  typically 
do  not  use  eomdinaie  values  hot  isthcr  talk  about  Objects  io  the 
ceaicr.  atthetop^oratthekrtorthe  acnca.  Aoooedini  to  the 
liocarity  ptiadple  it  is  tbetefore  ueoctiaiy  to  icpRaent  thoe 
Tuzzy*  abnluie  poritiona  (6)  shows  an  example  of  a  fuxzy 
absolute  positiOB. 

mX  object  d3  fabspos  oeatcr  modality  funetioa)  (6) 

OincDtly  the. exact  meaaiat  of  the  fuzqr  tesms  is  still  under 
iitvcsci(atiaa.  We  have  done  a  psycholocfcal  pilot  study  with  20 

subjem  to  hud  out  what  people  thiak  ’Icftaek*  mrsns,  whi^ 
has  not  yet  bem  totally  evaluated,  fruff  absolute  positions -used 
■a  this  expeiiaoeat  asc  tOfC  bottom,  kf^  t^ht.  ceater.  upper  left 
coraer.  upper  right  ooeaer.  tower  left  coner.  aad  lower  right 
cotner.  The  teno  “fUixy"  k  aot  lekted  to  Zadeh^  fuxzy  logic 

(in 

2.  Kolatlvo  fostdoas 

Propoaitioae  about  icladvc  poritkas  eaa  be  divided  into 
different  groupik  aeoofdlag  to  a  nuiUber  of  criteria.  The  &rst  dis- 
tiactioa  k  between  numeric  positions  (what  we  refer  to  as  *ooa- 
crett*‘.positione)  aad  fmof  poritknn  numcrie  positions  there 
are  at  leM  three  different  ways  to-inttiprtt-  coordiastt  values. 
Values  CM  be  given  in  pixclh  or  thqr  «i  be  muldpks  of  the 
sizes  of  cither  the  objeet  or  the  reference  object  involved. 

The  refertnee  Object  might  be  given  cxplkitly  or  implicitly, 
la  the  eeooad  caw  there  must  be  a  •hupefpart*  of  the  object 
which  will  be  used  as  the  reference  Objeo.  Hnally  it  aright  be 
the  cam  thu  a  rektlve  poaMon  ir  inherited  fiom  a  class  of 
objects.  IdMy  of  the  jivm  rtprmntstloosl  posslbilltks  can  be 
combined  with  each  other. 

a.  FUzxy  Kolatlvo  Vesitleaw-As.for  fuzzy  afaseluie 
poritioBs.tho  aMljnk  of  the  eemenrire  of  fuzzy  rektive  positions 
is  still  note  'My  siad  baaed  on  experimental  data. 

mX  Object  dSfrelpos  left  rcHodl  modality  fbaetksO  (7) 

(7)  deacribes-thc  proposMon  that  O  k  left  iff  dL 

Unfottuaatcly  there  art  a  nnmbtg'ef  tezy  rektive  pori* 
tkn  dcmeiptlons  whtt  do  aot  rely  on  Waaiy  rrierioas,  A 
representation  for  *betwmn*.  whkh  hm  two  refereaee  objects  k 
shown  in  (tX  More  dificnlt  sre  *bn  one  line*,  'logcthet'.  end 
“forming-a-cii^*'. 

mX  object  d99  (t) 

frelpos  between 

tci-toldn 

rel-t02d97 
modality  fuaetko) 

b.  GoneeuM  RoUthro  Foritiaas^We  will  begin  this 
sectioa  with  an  rrsmpk  fw  o  leklivt  poritka  metsiued  k  pixel 
BMrdinatea.  Hg.  3  riMwa' m  cnmpk  a  muldpUer.-  The  Uttk 
bkefc  bonea  he  the  pfcasre  arc  pons  (rid)  of  the  muldplier  snd 
have  thdr  own  foemn 

mlO(  objeet  pott3  (9) 

rdpoo  mix  >  34  y  4) 
reHoDlMl 
modality  fnnetkn) 


R 


RguraS 

A  MuUpaor  udOi  3  Ports 

kZrizns.  kboOislzas 

ports  b  ono  bodytongtti  away  from  R 

(9)  describes  the  rektive  positkn  of  port3  ss  being  34  10  the  right 
of  DIMl.  aad  4  above  it.  Dktaaocs  icfcf  to  the  reference  point  R. 
If  the  rekdye  poritkn  of  a  part  of  m  object  k  given  in  pixel 
ooordiaatci  thdi  a  peoblcm  with  acallag  resultc  not  only  objscu 
have  to  bt'seakd,  but  ako  rckdvc  poritkeia.  Thk  k  unssUfying 
becaum  It  dam  not  expecsii  the  fundamental  lavsrisnoe  of  the 
poritkn  of  the  ankpait  to  Its  snperfsrt.  Foctunsicly  it  is  possi-  - 
bk  to  rtpiestnt  tho  reiatka  betwoni  m  object  aad  its  submits 
preserving  tba  conceptual  posiricnal  fatvarisnoe  by  using  *^y 
coordinate.  Them  coordlaatm  repremat  a  rektive  pooiion  ss 
muldpka  of  tbs  rim  cf  the  rdcvMt  Object. 

mtX  object  ports  (lO) 

relpoB  mtX  bx  3  by  I) 
icI-toDlMI 
modality  fttaetka) 

(10)  shows  the  same  rckdvc  poritka  ss  (9X  however  asmraing 
that  object  pest3  hao  a  length  of  t  pixek  aad  a  width  of  4  pixels. 
The  fckdvc  poritkn  “T,  k  a  iMidpk  cf  the  size  of  pottJ.  The 
length  aad  width  of  M  ehjaa  are  the  length  and  width  of  the 
amalleac  anrrouatfag  netangk  of  it  wluch  .has  lines  parallel  to 
the  coordinate  asm  (‘VztentT  X 

.  Intuitively,  the  reprematadon  cxpceiaes  the  fan  that  a  big 
man  has  hk  azaia  far  away  fiom  hk  nadc.  and  a  small  chiM  has 
its  anaa  near  to  tho  nsefc.  hut  tho  ratk  of  the  dktanoe  and  the 
rize  of  tho  pewon  rimuM  ho  oppstndaaatcly  a  oonstaat. 

Usually  then  will  bo  a  number  cf  objects  given  with  rek- 
dve  poritkan  to  tho  aamo  rifcrcam  object.  Thk  aaaiea  h  dear 
sbk  to  ipseif>  rclulvu  poritkws  in  body  epasdiaates  of  the  refer- 
caec  object,  riwrtly  railed  rtfertnm  object  cooriiastm  (denoted  by 
the  arci  bex  aad  btyX 

ml4(  object  ports  (H) 

rcipos  mix  bn  I  bry  Ol33) 
rd-to  DlMl 
aaodality  fuacdon) 

(11)  CM  be  iaterpmad  in  the  mme  way  ai  (lOX  except  that  this 
dmc  the  faetoeo  (after  *bn*,  ’Tiry*)  apply  to  the  rize  of  the  refer¬ 
ence  objeet,  which  k  amumed  to  be  34  pixek  long  and  12  pixels 
high. 

c.  Kxi^kdt  voraua  ImpUett  Kaferenos  Objects-  In 
all  caaca  so  far  tho  refereaee  objeet  of  a  rriadve  poritioa  sute- 
oieat  was  given  whb  0  rd-to  are.  la  tba  dicuit  board  mainie- 
aanoc  domain  a  lat  pan  hicrareby  k  uaed.  There  k  one  mapr 
objem,  the  board,  whkh  hao  asMy  different  ,  paiw  whkh  abould 
msonobly  be  placod  tdaeive  to  tUe  main  object,  k  would  be 
redundMt  to  amen  the  reference  object  for  all  the  psris.  and 
therefore  a  default  aaaiimption  k  ptactkal. 
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■ufai«^«rir^Ks  MO  (u) 

05  woJtiUyftiactloa)  (t^ 

(15>  *tm*  •  pMt  tmmkm.  •  Oiwil^Ow  tool  dMt  «tQ  ht 
frritwM  IMH  M.  Binni  if  fnT  Ttii  rikilTi  iniilni  iwiinil 

tgr  (12)  «iU  kt  iMiifMHi  M  nM«t «  Oi. 

CMUMMiMi  «r  tkt  mpmhmmIomI  tamumem  l^na<^o>^ 

■fc  is  twirtml  poirfMc.  fm  Imumm  m  lapllck  MtetMe  abiget 
mmy  ke  mM  wMi  aO  tjfti  at  nImIwi  oaoiOlaim  iadadi^ 
fany  «aai(K  tSX 

ailX  abjw  47  fidfot  left  wlgll»ar  faartlaa)  (14) 

«20(MjMd«aabTM47Med^fbaeiioa)  (l5) 

4.  hltwiiad  Madaa  tbdrtMa  If  aat  aider  hi«  in 
im  fon  M  hair  a  Body  kafik  rMB  In  MtonMrpalat,  tiMa  tUi 
will  pawuaahly  hold  tmt  far  all  (he  addcM  la  the  qram,  aad 
aaa  woaM  aoi  waai  ta  aam  thb  aair  aad  aa«r  afda.  A«la* 
doa  to  iWb  laaMcai  b  <a  aakc  dw  lalailat  poMoa  kadf  iaherit* 
abb.  Thb  apdaa  h  aaaatoOfaO  kgr  (ha  fallin»la(  tot  af  pnpod* 
ildMa  TIm  vristivt  pmMmi  h  flwM  is  nflMSot  sooidi* 


irn  dwaMd  aiw  Mpaaaaadaa  at  a  daipla  pan  nMoto 
Aa  dkitn  caa  or  aMiae  haac  aMK  thaa  aac  pan. 'Ibt  ahifaliM 

aMdaliqr  atiaiaa  a  apadal  lanpawaaBr  far  pan  hlwawhin.  Or- 

cabi  Hkc  AND  pMCi.  OR  fataa  etc.  art  dfaplapaO  aa  ah^  dklna 

ia  a  laB<<«l  OhCf  hi  laal  hardwan  there  an  aaaaRj  faar 
Unuy  AND  fatca  ia  a  aia(k  cUpi  There  Caar  galea  he 
pane  aT  dUrenat  lagbal  aaba.  lieweeet;  ia  a  phyeical  aepweaa- 
utiaa  all  faarar  theai  aMat  he  parte  af  the  aean  iattgtated  dr- 
caiL 

t.  AaaaathUae 

Work  ea  the  aufaucaaaec  pan  af  the  VMES  peqitct  haa  lad 
to  the  iralbartca  that  eenaia  ahjeeta  ehaald  aewer  he  dhpleyad 
wiihoat  their  pane.  Per  ianaace,  a  pan  h  a  pan  af  a  toaWpUer. 
but  a  aeahipUrr  ahoald  aean  be  dlepleyed  without  be  pana 
.Tab  eeenahllia  aaa  thctcran  elbjgeia  that  haac  a  teal  pan-whale 
idatiea  to  a  apaetfe  abjen  aad  .which  ate  eappaeed  to  he 
dbplaped  wheaeacr  the  object  thep  are  pan  of  b  ^tolapad. 

The  icpreantatioa  at  aab  aariaMbe  b  eiaUlar  to  pan* 
trhob  leiatioa^  caeept  that  the  arc  ’hubaaeeaat'*  b  aaed  iaataad 
of  *Wb-paeti^. 

aOO(  object  dIO  eah  aeanw  dh  laedelity  Ihactioa)  (22) 


ai2l(oh>c«d9tpptbdr*addtrtoadalitpfaiietba)  (1«) 

■22(abjtetdMaabpaned9andatttprhiMtioa)  til) 

ae22Caabrteaehelf  edderrleet  edibr  aeadelty  (toeetba)  (iD 
■24(eb»ndlO  facto  add  ■BitlhyftMctha)  (IB) 

to2S(clatoaddarii^to2«(hn2hcy  S)  (2(0 


OdX  (liX  rod  (2(0  wftdtj  the.toiatiaa  padtiaa  at  dB 
whhh  b  lahccitod  riaai  the  efato ‘hddee^dDapadfae  the  nfer* 
eaee  Ohjeet  dM  hgr  faeaeaf  beeaperpen  iilirfiaahtp  toda.(IB) 
b  oaetatMy  to  panak  the  deritadboar  dn  ifae  af  dlO  whkh  ki 
tone  b  ainiaeeiy  far  the  eaaipacatlaa  at  tafcNaer abject  aaoMH* 
aatea. 


X  Logical  Beeeaht  with  iboy  PeeMaa 

The  fallawli^  atianaee  b  a  SNefS  reh  thn  irpneeti  the 
fact  that  V  OM  abject  b  Wh  of  aaaiher  akieec.  that  the  ether 
e^eet  aaam  ha  ii|jK  at  dn  faat  abject  aad  ebc  acmVIbr  a 
detalhdeeplaaedaaaf  the  acnicaaieaf«WeW  tuba.  aeetK 


to2Xa«k(vf  e2a3)  (21) 

thiefal 

aeg  (at2t  abject  el  ed-to  e2  andeBty  V)  ffdpac  left) 
aig(to2B abject vTieHavl  toodatyeB f ad^ dghtO 

If  the  kaarwledge  baac  aaatdae  the  abealaie  porfdaa  af  B  aad  the 
fanp  paddaa  aPB  eelathw  to  A  bat  ao  paddaaal  haTottoadea 
about  A  bedf.  thea  Ah  taqr  paridoa  eta  be  derived  whh  tub 

(21)  or  a  vuiadoa  of  k. 

D.  fdrtbgRrtnx  aad  AmWw 
Pen  hbcaiehlee  ere  a  OBaaaaaly  aaed  wacTnirr  ia  AI  (2(0 
Oar  leeeerrh  haa  iadlealed  that  a  pan  hbiairhy  aieat  b  art 
eadiciriit  for  gtaphbhl  deep  kaowladgc  wpieawratloar  We  have 
added  two  other  qrpee  it  pan-like  hbrnehie^  called  eeennbllia 
aad  daaten: 

The  dbplay  af  a  eoakdirited  abject  with  aevenl  levcb  af 
parti  aeight  be  bapnadWi  ao  a  Ihabad  wlatlea  dbphp  dewtoe. 
A  aataial  way  to  liaRt  the  eaaeplciity  af  aach  a  dieplay  tadi  b 
to  liaeh  the  autober  oT  kveb  of  the  hbcaichy  that  aie  actually 
dbptoyed.  Thb  b  a  very  degaat  adatiea  becMae  it  daei  act 
requite  the  inuaductioo  at  aay  aew  fcprcMatatbaal  eoaaract. 


X  aaetara 

Briatad  dieak  boarde  eeiatriMre  dww  greapa  at  akjKto 
that  .  ataad  ia  a  lagicd  icbtba  to  each'hthcr.  ceaipatabk  to  a 
pait*trheb  adadea.  Nevenhehto  they  aia  adthcr  aakpane  aar 
lah  eaimWIw  Sakpaiti  aad  aab  caaiddln  haW  a  atola  aOJaei 
dMt  b  baeir  dbplayable^  Ia  that  hto  a  fana.  liewevci;  a  giaa^ 
lag  of  cnmpnnrati  aaight  ceaebc  of  abjecti  of  the  aitoc  dae  aad 
laipenaacc^  aaae  at  which  dcatrad  the  atataa  of  ania  ohjKt. 
Hg.  4  ihawa  a  vritage  dMdcr  aad  a  T  Slier  which  an  typM 
eaaaiplci  af  aach  dfcaha. 

Agtoapiag  which  cdaiaaaly  aaaa  abetractioa  bcallad  a 
CCWHUW  If  SM  SCNSibiMBi  tiM  SBMKfS  of  CtMtCP  witll  tkt  C0WS|S 
of  bad  a  dilctoaea  aaeetgea.  Ehher  the  ahoact  abject  b  kft  oat 
of  the  hicraichy  (which  b-aadcriiable.  bacaaac  aaydriag  that 
atctoaaaCBial  to  a  petaea  ehaald  be  dicactly  npnaeataUe  ia  the 
aatWQik  (LfCOl  or  the  abauact  dhject  b  pat  ia  the  hiemchy  aad 
the  abjMlMf  On  claitar  an  atode  be  pem.  Bat  aaw  the  Idea  af 
ena^  iinfTT*T"  dbplaya  by  BtoMag  the  autober  af  Icadb 
dbpbyad  deer  aat  work  aay  aean.  becaaae  the  ahiact  abject  b 
oatdikpiayabicia  thaaaaaeacaieaanaiebjeettaic.  Monawerlf 
eae  b  wUHag  to  ghn  aa  Ohatiaa  abject  a  ayafaoUe  facam  thea 
bafa  the  aptohaUe  faito  aa  wdl  aa  the  duatcr  ekaMati  taaald  be 
dbpbyad  if  ear  waaie  to  aee  all  the  Icvebof  the  pan  hbraiehy. 
Thb  weald  aatopUcatr  the  dbplay  aaaeoeaeary. 

.  Oar  aaiwir  to  thb  prabbto  b  tocieaie  aa  addhloail  hbrar- 
chy  .which  ataada  eotorerbcia  ia  hetweea  a  pan  hbraiehy  aad  aa 
abetnedoa  hbraiehy.  if  A  b  aa  Object  (wbhoot  fam)  whkh 
haa  aakelaatcn  X  C  aad  D  thea'A  will  be  dbpbyed  aaly  by 
dbpfayiag  B,  C  aad  D.  However  if  a  partial  db^y  b  eafoiacd 
b  a  way  that  weald  cadade  the  kvd  of  X  C  aad  D  fren 
ehewiag.  A  will  be  dbpbyad  eyabolbally  by  a  boa.  akte  to  the 
diipby  format  ia  Mock  diagiaato..Rg.  S  abowa  the  aew  dbpby 
fanhat  for  i^.  4j  The  aetwoik  npieaeataiioa  at  a  aubelaettr  b 
ihowo  by  (2311 

ia.l|(  abject  dIOaoh«luetcndB  modality  fanctioo)  (13) 

E.  Attrilmtaa  aad  Attribatt  MaoBiara 

Out  iaepocttoit  factor  ia  derigaiag  a  eystem  band  aa  giaphi- 
cri  deep  kaowledge  b  a  dear  aepaiatioa  brmreca  boaa  aad  the 
abjecti  that  an  lepceecnted  by  then  bone,  aa  eiaervation  that 
bm  been  made  by  othen  aleo  (llj.  Thb  aepaiatioa  foroee  eae  to 
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ARTIFICIAL  INTELLIGENCE 
AND  AUTOMATED  DESIGN 

Stuart  C.  Shapiro 
James  Geiler 

Department  of  Computer  Sdettce 
State  University  of  New  York  at  Buffalo 
Buffalo.  New  York 


Artificial  Intelligence  (AI)  offers  to  the  design  task  the  use  of  powerful  sys¬ 
tems  that  can  be  knowledgeable  assistants  to  the  human  designer.  Knowl¬ 
edge  Representation  techniques  can  be  used  to  specify  the  ontology  and 
epistemology  of  the  pardctdar  design  task  so  an  Intelligent  Interface,  in 
general,  and  an  Intelligent  Drafting  assistant,  in  particular,  can  discuss  the 
task  with  the  designer  using  the  same  concepts  that  he  uses.  Investigating 
Knowledge  Representation  formalisms  for  such  aids  in  the  context  of  devel¬ 
oping  a  Versatile  Mainterumce  Expert  System  (VMES)  has  uncovered  a 
number  of  interesting  concepts  that  seem  useful  for  a  wider  class  of  design 
domains.  These  concepts  are  presented  after  a  general  discussion  of  the 
role  of  AI  in  design,  and  an  introduction  to  a  particular  AI  Knowledge 
Representation  system.  The  role  of  design  aids  and  Intelligent  Interfaces  in 
VMES  is  presented  as  an  example  of  the  use  of  such  systems.* 


*This  work  was  supported  in  part  by  the  Air  Force  Systems  Command,  Rome  Air  Deveiop- 
meni  Center,  GriflUs  Air  Force  Base,  New  York  1344r-S700.  and  the  Air  Force  Office  of 
Scientific  Research,  Bolling  AFB  DC  20332  under  Contract  No.  F30602-83-C^XX)8,  which  sup¬ 
ports  the  Northeast  Artificial  Intelligence  Consortium  (NAIQ. 
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□  ARTIFICIAL  INTELUGENCE  AND  DESIGN 


Tlie  task -of  design  presents  intelUgeot  humans  with  a  large  number  of  com¬ 
plicated  problems.  Artificial  intelligence  (AI)  is  the  research  area  which 
attempts  to  discover  how  to  program  computers  to  solve  the  sort  of  prob¬ 
lems  intdli^nt  humans  tackle.  One  use  of  AI  in  design  might  be  to  have 
an  AI  system  that  would  do  the  design  itself,  perhaps  viewing  design  as  a 
seardi  through  a  design-problem  space.  In  this  paper,  however,  we  will  dis¬ 
cuss  two.  aspects  of  the  application  of  AI  as  design  aids  for  human  design¬ 
ers  —  the  application  of  Knowledge  Representation  to  drafting  systems,  and 
the  use  of  littdiigent  Interfaces.  After  some  introductory  remarks,  we  will 
give  a  brief  introduction  to  the  AI  system  we  are  using,  present  some  resulu 
of  dur  investigations  into  the  i^pUauions  of  AI  to  design,  and,  finally, 
show- how  this  fits  into  a  Maintenance  Expert  System  we  are  developing. 

The  Role  of  Knowledge  Representation 

Modem  computerized  drafting  systems  supply  their  users  with  a  wealth 
of  powerful  modding  topis..  A  typical  drafting  system  deals  with  objects, 
their  visual  and  non-vi^ual  attributes,  and  their  mappings  into  graphical 
representations.  However,  such  a  system  is  only  a  powerful  set  of  pens,  it 
is  not  an  assistant  that  ^knows**  what  the  designer  is  talking  about.  To  be 
intelligent;  an  assistant  must  be  knowledgeable.  Knowledgeable  computer 
systems  are  known,  as  **Knowledge-Based  Systems"  (KBSs).  and  are  a  very 
active  area  of  AI  research  and  devdopment. 

We  can  identify  three  roles  that  people  play  in  the  design  and  use  of 
KBSs.  Hrst,  there  are  people  who  design  and  implement  KBSs  without 
regard  to  any  particular  application  domain.  We  can  refer  to  such  people 
as  the  KBS  Designers,  and  to  the  results  of  their  effbru,  using  terminology 
from  the  fidd  of  Expert  Systems  (ESs),  as  “KBS  shells."  Second,  there  are 
those  who  particularize  Kl^  shells  to  given  application  domains.  They  are 
called  “Knowledge  Engineers"  (KEs)  in  the  K  world,  and  we  can  refer  to 
the  results  of  thdr  efforts  as  K^  simpliciter.  Finally,  there  are  the  "end- 
users"  who  use  KBSs  as  tools  to  get  particular  jobs  done. 

The  job  of  a  KE  is  usually  percdved  to  be  interviewing  a  person  already 
knowledgeable  (at  an  e]q)ert  levd)  in  the  application  domain,  and  recording 
that  person's  knowledge  in  a  form  that  the  KBS  shdl  can  use.  However,  if 
the  shdl  Is  flexible  enough,  there  is  an  additional  task  for  the  KE:  to 
design  the.  “form"  in  which  the  knowledge  is  to  be  recorded.  This  task  is 
the  Knowledge  Representation  (KR)  task,  and  we  will  refer  to  the  KE  per¬ 
forming  this  task  as  the  “Knowdedge  Representation  Engineer"  (KRE). 
(The  KRE's  task  has  jocularly  been  called  “notational  engineering.")  The 
KRE's  first  task  is  an  analysis  of  the  knowledge  primitives  in  the  domain. 
He  must  define  the  domain’s  ontology  (the  kinds  of  objects  and  attributes 
contained  in  the  domain),  and  ks  epistemology  (the  sorts  of  things  one  may 
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know  about  the  dtMnain,  and  the  ways  of  knowing  them).  A  flexible  KBS 
shefl  wfll  permit  the  KRE  to  do  this  dedaradvely,  Le.  without  re- 
progranmiinf  the  shell. 

The  KRE  can  supply  a  vocabulary  of  conoepti^  objects«  rdadons,  and 
attribute  without  a  lii^  on  the  levd  of  object  abstraction.  For  example, 
oat  can  take  the  system's  representation  of  an  object,  and  its  represenution 
of  the  depiction  of  the  object  on  the  screen,  and  create  an  explicit  non¬ 
procedural  mapping  between  them.  This  mapping  itsdf  can  be  reified, 
whidi  makes  it  in  turn  amduble  to  serving  as  an  object  in  a  propositional 
context.  This  example  only  involves  two  levels  of  abstraction  and  is  fre¬ 
quently  useful.  For  instance,  it  may  be  used  to  assert  the  validity  of  a  map¬ 
ping  tto  might  be  limited  to  particular  circumstances. 

The  declarative  representation  of  these  objects  has  the  additional  benefit 
of  placing  them  in  tte  domain  of  possible  end-user  .queries.  Whatever  is.  a 
concept  for  both  system  and  user  can  be  discussed  by  them.  The  user  can 
tell  the‘system  ab<w  them,  and  can  ask  the  sjyteni  udutt  it  currently  knows 
about  thm.  The  system  can  have  rules  that  spe^  how  to  reason  about 
them,  how  to  derive  new  attributes  from  old  ones,  a^  even  under  what  dr- 
cumstanres  to  infer  the  existence  of  objects  it  han't  been  explicitly 
informed  about. 

A  Knowledge-Based  drafting  system  can  be  an  intdligent  assistant  to  a 
designer,  rather  than  just  a  powerful  drawing  tool. 


Intelligent  interfaces 

Recently,  there  has  been  increased  interest  in  the  contributions  AI  can 
make  to  Urn  design  of  interfaces.  There  was  both  a  workshop  and  a  pand 
on  Intdligent  Interfaces  at  the  1986  AAAI  sponsored  Nationd  Conference 
on  Artificial  Intdligenoe,  and  DARPA  has  recently  funded  a  program  on 
Multi-media  Interfaces. 

Our  own  view,  (Sluq)iro  1986a]  is  that  an  intelligent  interface  needs  the 
following  capabilities:  it  should  krow  about  the  topic  under  discussion,  not 
merdy  be  an  isolated,  modular,  general  purpose  interface;  it  should  know 
about  communication  issues,  induding  what  is  on  the  screen,  and  the  rela¬ 
tionship  between  what  is  being  communicated  and  the  way  it  is  being  com¬ 
municated;  it  should  have  a  user  modd,  so  it  has  an  idea  of  what  the  user 
knows,  doesn't  kiibw,  and  what  the  user-  is  trying  -to  -accomplish;  The 
KBS-based  drafter  we  are  devdoping  can  be  seeta  as  an  appropriate  intdli- 
gent  interface  to  a  more  extensive  design  system. 


General  Introduction  to  SNePS 

The  SNePS  Semantic  Network  Processing  System  [Shapiro  1979;  Shapiro 
1986b]  is  the  KBS  shell  we  use,  and  we  will  use  the  SNePS  formalism  in  the 
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remainder  of  this  paper.  For  the  reader  not  familiar  with  SNePS,  we  will 
first  give  a  short  intr^uction  to  the  basic  properties  that  distinguish  it  from 
other  semantic  network  systems. 

SNePS,  unlike  semantic  network  systems  of  the  KL-ONE,  KRYPTON 
faihily,  (Brachhian  1985;  Brachman  1983]  but  like  Anderson  and  Bower’s 
HAM,  (Anderson  1973]  is  a  propositional  semantic  network  system,  /.e., 
the  main  ingredient  of  SNePS  networks  are  assertions,  constructed  from 
case  grammar-like  frames  (HUmore  1968].  This  does  not  imply  that  SNePS 
cannot  support  KL^NE  type  class  hierarchies  and  inheritance  [Tranchell 
19^],  but  that  this  feature  is  less  prominent  in  SNePS.  SNePS  is  a  fully 
intensiooai  knowledge  representation  system  [Shapiro  1986b]  —  it  can  rep¬ 
resent  ima^nary,  non-existing,  and  even  impossible  objects,  as  well  as 
abstract  objects,  and  multiple  guises  of  a  single  object  as  if  they  were  sepa- . 
rate  objects. 

SNePS  Aril  predicate  lope  with  universal,  existential,  and 

numerk-  quantification.  A  number  of  non-standard  connectives  that 
improve  expressibiliQr  are  available,  including  both  a  default  operator  and  a 
true  n^Stl^  SNePS  siqiports  forward,  backward,  artd  bidlrectiorud  infer¬ 
ence,  in  contrast  to  many  other  systems  which  permit  reasoning  in  only  one 
direotion.  For  instance,  the  OPS5  expert  system  shell  docs  only  forward 
inferenbe,  whereu  PROLOG  does  only  backward  inference.  In  SNdPS,  the 
saine  rule  syntax  can  be  used  for  dther  type  of  reasoning;  there  are  no 
specific  forward  or  backward  rules.  SNeK  permits  the  use  of  recursive 
rides,  dther  direetly  recursive  or  indirectly  recursive  [McKay  1981].  A  rde- 
vance  logic  based  (Anderson  1975;  Shapiro  1976]  extension  to  SNePS  per¬ 
mits  its  use  as  a  truth  naaintenance  system  (Martins  1983]. 

Another  advantage  of  SNePS  is  the  total  order  indep^ence  of  rules  and 
dausps  in  the  rules,  in  effect  dimlnating  the  painful  mixed  procedural- 
declarative  semantics  of  PROLOG.  This  higher  degree  of  flexibility  permits 
very  natural  representations,  espedally  for  natural  language  rule  expres- 
dons.  However,  the  required  compuution  times  are  usually  longer  than  for 
PROLOG  programs. 

Althou^  the  major  purpose  of  SNePS  is  not  to  be  a  functional  model  of 
the  brain!,  oppos^  to,  for  instance,  Anderson’s  ACT  system  [Anderson 
1983],  SNePS  has  been^dedgned  with  a  high  degree  of  cognitive  validity  in 
mind.  This  is  expressed  by  a  differentiation  between  conceptual  and  non- 
concepcuai  rdadons,  by  the  imposdbility  of  PROLOGish  retract-iike  forced 
forgetting  (except  for  debugging  purposes),  and  by  the  accessibility  of  all 
information  about  a  eonoept  from  the  concept  itself. 

.  A  number  of  different  SNePS  interfaces  have  been  designed,  containing 
several  natural  language  parser/generators  for  subsets  of  English,  a  frame¬ 
like  editor,  a  logic  programming  language,  and  several  graphics  interfaces. 
In  our  dmcripdon  of  knowledge  struaures  we  will  liberally  use  the 
’’Lispisb”  notation  of  the  SNePS  User  Language  (SNePSUL),  or  our  stand¬ 
ard  graphical  represoitation  of  SNePS  networks. 
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Knowledge  Representation  in  SNePS 

In  this  section,  we  will  discuss  an  example  SNePS  network  to  introduce 
the  syntax  and  semantics  of  some  of  the  representational  structures  we  use 
in  our  work  on  VMES,  the  Versatile  Maintenance  Expert  System  [Shapiro 
1986c].  Hgure  9.1  shows  an  Adder-Multiplier,  a  simple  experimental  device 
that  has  been  used  in  the  field  of  hardware  maintenance  research  by  a  num¬ 
ber  of  people.  This  object  consists  of  three  muitipiiers  and  two  adders. 
Figure  9.2  shows  part  of  the  semantic  network  that  describes  this  device. 
Rectangles  in  Rgure  9.2  represent  concepts  of  real  or  imaginary  objects. 
Circles  represent  propositions  about  these  objects.  The  network  can  be 
read  as  follows:  D1  is  an  object  of  type  M3A2;  DlAl  is  of  type  Adder  and 
is  a  part  of  Dl;  DIM!  is  of  type  Multiplier  and  is  a  part  of  Dl;  DIAIFI  is 
a  Ft^  Adder  a^  is  part  of  DlAl;  etc. 

The  SNePSUL  commands  that  create  the  network  of  Rgure  9.2  are: 

(define  part-of  object  type) 

(bui  Id  object  01A1 
type  Adder 
part-of  01) 

(bui Id  object  01M1 
part-of  01 
type  Multiplier) 

(build  object  01 

type  M5A2) 
part-of  01 A1 
type  Full  Adder) 

(build  object  01A1F1 
part-of  01 A1 
type  Full  Adder) 

(build  object  01A1F2 
part-of  01A1 
type  Full  Adder) 

The  first  define  command  defines  the  arcs  to  be  used  in  the  system.  Arcs 
can  be  followed,  for  retrieval  purposes,  in  either  the  forward  or  backward 
direction,  guaranteeing  the  universal  accessibility  of  every  node  from  every 
other  node  that  is  related  to  it. 

The  set  of  bui  Id  commands  creates  the  actual  network.  Note  that  every 
build  command  will  result  in  the  creation  of  one  node.  These 
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nodes,  ns  described  earlier,  correspond  to  propositions  in  the  system  and 
cannot  be  created  directly  by  the  user.  In  other  words,  it  is  not  possible  for 
the  user  to  create  an  arc  connecting  two  nodes  named  by  him,  guarding 
users  against  creating  non-conceptual  propositions,  objects  the  SNePS 
theory  of  mind  does  not  permit. 


TV 

paxt-of  pvt-of 
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□  AN  ANALYSIS  OF  IMPORTANT  ELEMENTS  OF  DESIGN 
KNOWLEDGE 

Having  introduced  the  SNePS  KBS  sbdl,  we  will  now  discuss  the  ontology 
and  representational  constructs  that  we,  in  our  role  as  KREs,  have  found  to 
be  necessary  for  creating  descriptions  of  graphical  depictions  of  simple  cir¬ 
cuit  b<mds. 

Objects  and  Forms 

The  first  fundamental  unit  we  need  to  deal  with  is  the  displayable  object. 
In  order  to  create  a  picture  of  an  object  it  is  necessary  to  specify  a  form  for 
it.  Every  form  has  a  dual  role.  On  the  one  band,  it  can  be  used  to  create  a 
picture  of  that  form.  On  the  other  hand,  it  is  a  conceptual  unit  in  the 
knowledge  representation  system  and  can  be  manipulated  u  such.  Picture 
creation  is  done  by  a  Lisp  grqthks  function  whose  name  is  identical  to  the 
form  coneqn  in  the  network,  and  whose  arguments  are  the  coordinate  posi- 
tioru  of  the  place  the  form  is  to  be  drawn.  So,  if  the  form  of  a  particular 
gate  is  sped^  by  the  function  gata-fom,  the  gate  would  be  drawn  at  posi¬ 
tion  (100,  300)  by  evaluating  the  Lisp  form: 

(gate-fom  100  300) 

The  degree  of  spedfidty  of  a  form  varies.  While  the  form  of  sin  inte¬ 
grated  circuit  or  a  transistor  is  totally  fixed,  the  form  of  a  wire  is  dependent 
on  the  position  of  the  ports  it  connects.  If  a  user  wishes  to  display  an 
abstract  object  then  he  hiu  to  supply  a  symbolic  form  for  it. 

Positions 

The  next  essential  ingredient  for  a  drafting  s)rstem  is  the  concept  of  posi¬ 
tions.  There  are  several  possible  ways  of  specifying  positions.  In  a  tradi¬ 
tional  CAD  system,  positions  are  only  expressed  in  im  absolute  or  relative 
manner  based  on  coordinate  values.  This  is  an  ability  that  a  KBS  should 
also  have.  However,  knowledge-based  design  systems  should  also  be  able 
to  deal  with  relational  specifications,  such  as  the  specification  that  a  certain 
element  should  be  near  or  to  the  left  of  another  element.  This,  of  course, 
introduces  a  certain  fuzzyness  in  the  representation.  However,  in  many 
cases  this  is  exactly  what  a  designer  would  like.  It  permits  him  to  think  in 
concepts  that  are  natural  to  him,  and  it  avoids  unnecessary  specificity.  In 
other  words,  a  knowledge-based  drafting  system  permits  one  to  spedfy  spa¬ 
tial  relations  with  a  reasonable  degree  of  imprecision. 

The  following  SNePSUL  commands  show  first  our  representation- for  rel 
ative  coordinate  positions,  and  then  for  fuzzy  positions: 
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(build  object  gate-1 

relpbs  (build  x  10Q  y  200) 
ret-to  gate-5 
iiodality  function) 

(build  object  gete-2 
relpos  left 
rel-to  gate-1 
■odality  function) 


The  first  SNePSUL  command  will  create  a  piece  of  SNePS  network  rep¬ 
resenting  the  proposition  that  gate-1  is  100  units  to  the  right  and  200  units 
above  gate-S.  The  second  one  asserts  that  gate-1  is  to  the  left  of  gate-2. 
The  aodelity  dot  is  used  to  differentiate  between  different  arrangements  of 
an  object  in  a  functional  representation  (wire  plan)  and  a  physical  represen¬ 
tation  (picture  of  the.board). 


Atfributes 

Attributes  can  either  be  of  objects  or  of  pictures  of  objects.  An  example 
of  an  attribute  of  a  picture  is  bJinkint.  A  blinking  picture  can  help  a  user 
focus  his  attention  on  a  currently  interesting  object,  without  expressing  any¬ 
thing  about  the  object  itsdf. 

An  example  object  attribute  we  have  been  using  is  the  faultiness  of  a 
gate.  The  proposition  that  gate-1  is  faulty  would  be  represented  by  the  net¬ 
work  built  by  the  command: 

(build  object  gate-1 

attr  (build  atrb-cls  state 

atrb  faulty 

■odality  function)) 

In  order  that  the  system  know  how  to  display  a  faulty  gate,  we  tell  it  that 
the  state  attribute  maps  to  the  state-to-color  function: 

(build  attr  state 

■od-func  state-to-color) 

Each  attribute  function,  such  as  state-to-color,  is  actually  a  funaional 
that,  takes  a  form  function  and  an  attribute  value  as  arguments,  and  returns 
a  modified  form  function.  So,  again,  if  gate-1  had  the  form  represented  by 
the  function  gate-form,  and  given  that  gate-1  is  in  the  state  of  being  faulty, 
and  that  the  attribute  function  for  state  is  state-to-color,  gate-1  would  be 
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dMayed  at  faulty  at  coordinate  podtion  (100,  300)  by  evaluating  the  Lisp 
fonn; 

(funcell  (state-to^lor  #*gat»-foni  'faulty) 

100  300) 

Notice  that  representing  different  attribute  dimensions  (state;  color,  size, 
etc.)  by  different  attribute  functionals  explicates  the  way  that  different 
attribute  dimensions  are,  in  fact,  diffoent. 

In  this  technique,  the  information  of  how  to  display  a  faulty  gate  is  pro* 
cedurally  encoded  in  the  state-to-color  functionid.  An  alternative  is  to 
store  the  information  dedarativdy  in  the  network,  such  as  V  *  proposition 
built  by  the  command: 

(build  attr  state 

atrb  faulty 

■od-val  rad) 

This  proposition  says  that  the  attribute  of  being  in  a  faulty  state  is  to  be 
shown  making  the  dlqilay  red.  The  fact  that  red  is  a  value  of  the  color 
attribute  is  stored  by  a  separate  propbsidon. 

Class  Hierarchy 

An  important  feature  of  most  knowledge-  representation  systems  is  their 
ability  to  handle  dosses  of  .<d>jects  (and  also  hkrardiies  with  many  levels  of 
dasses).  This  permits  a  user  to  associate  an  mtribute  with  an  entire  dass 
instead  of  a  single  object.  Fm  example,  one  could  express  the  fact  that  all 
integrated  dreuits  expect  ground  potential  on  their  pin  0  by.assodating  this 
fact  with  the  dass  of  all  integrated  dreuits. 

(Masses  have  two  important  features  that  are  valuable  for  design  systems 
(and  KR  systems  in  generaO.  The  first  is  that  by  asserting  that  an  object 
bdongs  to  a  certain  class,  a  lot  of  new  knowledge  is  immediatdy  available 
about  it.  This  is  called  inheritance  along  a  dass  hierardiy.  The  other  valu^ 
able  feature  is  that  this  type  of  reproentation  seems  to  corre^nd  to  the 
way  people  organize  their  knowled^  Therefore  the  naturalne»  of  the  use 
of  dasses  also  improves  the  general  communication  between  user  and  sys¬ 
tem. 

Part  Hierarchy 

Another  feature  that  is  common  in  A1  systems  is.  the  use  of  part  hierar¬ 
chies.  Much  of  the  knowledge  about  physical  objects  can  be  organized  as 
facts  that  express  a  part-whole  relation  between  different  objects.  This 
applies  also  and  espedaOy  to  derign  systems. 
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Our  own  resear'^h  has  shown  that  the  concept  of  inheritabiiity  which  was 
mehtiobOd  for  class  hiefarchies  is  also  applicable  to  part  hierarchies,  but 
with  a  <^fference  that  we  have  not  seen  discussed  in  the  previous  literature. 
For  instance,  the  attribute  of  a  special  transistor  of  being  “twice  as  large  as 
an  average  transistor"  is  inheritable  by  its  paits.  On  the  other  hand,  if  a 
circuit  board  is  known  to  be  faulty,  nobody  would  want  this  attribute  to  be 
inherited  by  all  its  parts.  That  would  defeat  the  very  purpose  of  a  diagnosis 
system. 

In  class  hierarchies,  the  only  attributes  that  are  not  inheritable,  are  those 
that  apply  only  to  classes.  For  example,  the  cardinality  of  a  class  is  not 
applicable  to,  let  alone  inherited  by,  its  individual  members.  In  the  part 
hieraicby,  however,  there  are  non-inheritable  attributes,  such  as  faultiness, 
that  are  applicable  to  sub-parts,  just  not  to  be  inherited  by  all  of  them. 

The  representation  that  we  are  using  for  inheritable  attributes  is  the  same 
as  the  representation  for  non-inheritable  attributes,  and  is,  in  fact,  identical 
to  the  example  of  faultiness  given  in  an  earlier  section.  However  it  is 
possible  to  assert  in 'the  network  about  a  certain  attribute  that  it  is  inherita¬ 
ble,  simply  by  pointing  to  it  with  an  inheritable  arc.  For  example: 

(build  inheritable  size) 

The  display  pro^am  which  interprets  the  network  automatically  queries 
for  inheritabiiity  if  it  has  to  expand  an  object  with  attributes  into  parts. 
The  results'  of  this  query  determine  whether  or  not  the  parts  of  the  object 
are  displayed  as  having  ^e  attribute. 

Inheritabiiity,  as  an  attribute  of  other  attributes,  is  a  meta-attribute.  The 
fact  that  we  me  representing  it  explicitly  and  dedmatively  gives  the  user  the 
power  to  experiment  with  cUfferent  attributes,  and  to  postpone  the  decision 
about  which  of  them  is  inheritable. 

Our  findings  about  inheritance  can  be  extended  to  other  hierarchies, 
which  we  refer  to  as  relevance  hierarchies.  Relevance  hierarchies  are  an 
abstraction  of  a .  number  of  different  hierarchies  used  in  the  literature, 
including  topic  hierarchies  (Haan  1986]  and  hierarchies  of  spaual  universes 
(containment  hierarchies)  [Fahlmann  1979]. 


□  THE  VMES  SYSTEM 

The  research  described  in  this  paper  is  a  part  of  ihe  VMES  (Versatile  Main¬ 
tenance  Expert  System)  project,  which  deals  with  hardware  maintenance  for 
mixed  analog  and  digital  circuit  boards.  By  using  the  features  of  a  knowl¬ 
edge  based  architecture,  a  high  degree  of  versatility  has  been  achieved 
(Shapiro  1986c]. 

The  specific  significance  of  our  work  is  that  frequently  electronic  devices 
have  fairly  short  life  cycles.  A  new  board  is  designed  and  quickly  comes 
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iato  use  in  the  field.  There  is  little  time  to  design  einborate  test  procedures 
or  equipment,  or  to  educate  a  large  number  of  and  users.  Usu¬ 

ally,  the  only  real  expert  on  the  device  is  its  designer,  and  he  is  already 
involved  with  another  project  when  the  first  problems  in  the  field  come  up. 
Our  research  is  directed  toward  the  design  of  a  KBS-baMxl  drafter  that  the 
designer  will  use  to  help  design  a  new  device.  This  design  stage  will  be  the 
**Knowledge  Acquisition”  stage  of  the  VMES,  wfakb  will  then  be  able  to 
advise  maintenance  technicians  on  the  maintenance  and  repair  of  the  device 
that  it  helped  design. 

The  maintenance  system  can  also  be  used  as  a  part  of  the  design  system, 
since  it  can  be  used  to  detect  impossible  designs  which  do  not  conform  to 
certain  integrity  constraints.  An  example  of  such  an  ^impossible  design  in 
the  circuit  board  domain  would  be  if  a  new  device.that  is  described  to  the 
system  has  two  chips  with  their  input  ports  connected  to  each  other,  but 
neither  connected  to  an  outport  of  any  other  chip  (Figure  9.3).  Another 
example  would  be  if  two  points  are  dk^cally  connected  to  each  other  by 
two  separate  wires  (Figure  9.4). 

VN^  implements  a  large  number  of  the  concepts  which  have  been 
described  in  the  previous  sections,  i.e.  part  and  class  hierarchies,  inherit¬ 
ance,  attributes,  etc.  It  expects  to  talk  to  two  difiTerent  types  of  end-users. 
On  the  one  hand  are  maintenance  technicians  with  a  limit^  amount  of  edu¬ 
cation  and  training.  On  the  other  hand  are  the  designers  that  enter  a 
description  of  a  new  device  into  the  system.'  These  two  types  of  end-users 
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Figure  9X  A  rorJunctant  corvwctlon. 
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have  different  user  interfaces,  but  both  interfaces  are  required  to  be  natural 
ud.user'friendJy; 

The  need  to  create  descriptions  of  circuit  boards  quickly  and  without 
“progranuning”  requires  a  system  that  has  fairly  general  knowledge  about 
circuit  boards,  and  that  can  be  adapted  to  a  new  device  in  a  short  time  and 
with  a  natural  dialogue.  To  achieve  this  the  system  has  to  understand  much 
about  the  objects  of  the  domain,  like  wires,  inverters  or  integrated  circuits. 
The  of  a  Knowledge  Representation  language  is  a  precondition  for 
achie^g  such  understanding.  Use  of  a  component  library  also  permits  a 
rapid  change  from  one  device  to  another.  If  a  new  device  does  not  contain 
any  new  components,  then  it  is  only  necessary  to  describe  the  new  wiring. 

Oiir  approKh  to  the  design  of  Intelligent  Interfaces  may  be  explained  by 
a  description  of  three  interfaces  that  are  part  of  VMES.  The  main  user 
interface  is  a  Knowledge*Based  graphics  component.  This  program,  named 
display,  taka  a  piece  of  semantic  network  as  argument  and  usa  it  to  gen¬ 
erate  a  factorial  represent^on  of  the  stored  knowledge,  display  works  as  a 
generator,',  quite  comparable  with  a  natural  language  generator.  Only 
redundant  permanent  auxiliary  storage  is  used  by  display.  In  other  words, 
the  semantic  network  plus  the  Lisp  functions  de^bing  primitive  forms  are 
the  only  knowledge  sourca  for  the  computation  and  creation  of  device 
depictions. 

We  are  working  on*  displaying  devica  under  the  assumption  that  no 
coordinate  posidons  are  given.  We  refer  to  this  activity  as  intelligent 
madiine  drafting  (IMO).  We  are  attempting  to  provide  a  procedural  model 
of  nme  of  the  knowledge  that  a  drafuman  has  about  space  and  arrange¬ 
ment,  of  dectranie  components,  display  trim  to  arrange  components  of  the 
system  in  what  it  ‘’thinks"  is  a  graphically  appealing  way,  using  several  var¬ 
iations  of  an  equal-spadng  algoritiun.  Unlike  VLSI  routing  or  layout  pro¬ 
grams,  which  usually  try  to  find  some  space-optimal  solution,  display 
assuma  .thin  there  is  iunple  space  to  solve  the  placing  problem. 

The  second  interface  is  a  natural  language  understander  (NLU),  imple¬ 
mented  by  using  an  augmented  transition  network  (ATN)  [Woods  1970; 
Sluq)iro  l982]  semantic  grammar.  A  user  can  create  cias'fs  of  objects, 
assign  (predefined)  forms  to  them,  name  members  of  these  classes,  assign 
them  attributa,  and  then  display  them,  all  with  commands  from  a  (fairly 
limited)  subset  of  natural  language.  The  NLU  usa  the  same  KR  constructs 
as  are  used  by  display.  This  enabla  it  to  demonstrate  its  understanding 
of  dedarative  sentenca  by  drawing  the  object(s)  mentioned  using  appropri¬ 
ate  graphic  indicaton  of  the  asserted  attributa. 

The  third  imerface  is  the  readfons  facility,  which  allows  a  uMr  to  crate 
Lisp  form  functions  simply  by  drawing  objects,  readfons  permits  a  user  to 
create  pktura  of  objects  from  simple  primitiva  like  Una,  drcla,  boxa 
etc.  He  can  also  design  a  form  off  to  the  tide,  on  a  kind  of  scratch  pad, 
and  then  add  this  form  repeatedly  to  the  object  being  designed,  readfons 
will  assume  that  the  form  created  on  the  side  is  the  form  of  a  class  of 
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objects,  and  that  the  repeatedly  added  instances  are  members  of  that  class. 
These  members  will  also  be  assumed  to  be  parts  of  a  main  object,  consist* 
ing  of  the  primitives  placed  before  and  after  using  the  scratch  pad. 
readfona  verifies  some  of  its  assumptions  by  querying  the  user,  e.g.  asking 
for  a  name  of  the  susoected  ciass.  If  the  user  supplies  the  requested  names 
then  readfora  will  create  a  network  structure  that  asserts  the  class  and  part 
relations  and  will  even  store  the  positions  of  the  parts  reli.tive  to  their  super 
object. 


□  CONCLUSIONS 

A1  offers  to  the  design  task  the  use  of  powerful  Knowledge-Based  System 
shells.  Knowledge  Representation  Engineers  particularize  these  KBS  sheik 
to  the  particular  design  domain  by  specifying  the  ontology  and  epistemol¬ 
ogy  of  the  domain.  This  permits  the  end-users  to  discuss  the  design  task 
with  the  KBS  as  if  it  were  a  knowledgeable  assistant. 

We  discussed  two  aspects  of  KBSs  useful  for  design.  Intelligent  Inter¬ 
faces  know  the  task  bdng  performed,  know  about  the  objects,  relations, 
and  attributes  being  discuss^,  and  know  how  to  express  these  concepts  to 
the  user.  Intelligent  Machine  Drafters  (IMDs)  are  knowledgeable  assistants 
to  the  designer,  besides  being  powerfui  drafting  took. 

We  have  been  developing  a  Versatile  Maintenance  Expert  System 
(VMES)  that  would  be  able  to  help  a  maintenance  technician  repair  a  device 
that  had  been  designed  so  recently  that  there  would  not  have  been  time  to 
give  the  technician  training  on  how  to  repair  it.  llie  VMES  would  acquire 
its  own  knowledge  of  the  device  by  serving  as  an  IMD  to  the  original 
designer. 

In  our  roles  as  KREs  for  VMES,  we  have  identified  the  following  con¬ 
cepts  as  useful  for  an  IMD  and  for  an  Intelligent  Interface  to  a  design  sys¬ 
tem:  objects;  forms  of  objects;  absolute,  relative  and  "fuzzy”  positions; 
attributes  of  objects  and  of  pictures  of  objects;  attribute  functionals;  object 
attribute  to  picture  attribute  mappings;  class,  part,  and  relevance  hierar¬ 
chies;  and  meta-attributes,  such  as  inheritability. 
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V 

MISSION  i 

of  I 

Rome  Air  Development  Center  S 

114  DC  plans  and  executes  research,  development,  test  and  selected  ^ 

acquisition  programs  in  support  of  Command,  Control,  Communications  ^ 
and  Intelligence  (C^I)  activities.  Technical  and  engineering  support  within  ^ 
areas  of  competence  is  provided  to  ESD  Program  Offices  (FOs)  and  other  Q 
ESD  elements  to  perfonn  effective  acquisition  of  Cr  I  systems.  Die  areas  ^ 
of  technical  competence  include  communications,  command  and  control,  V 
battle  management,  information  processing,  surveillance  sensors,  V 

intelligence  data  collection  and  handling,  solid  state  sciences,  ^ 

electromagnetics,  and  propagation,  and  electronic,  maintainability',  and  ^ 

compatibility.  ^ 


